Control method for head-mounted visual apparatus, head-mounted visual apparatus and computer readable storage medium

Patent metadata

Field	Value
Publication number	US-11243608-B2
Application number	US-202016751226-A
Country	US
Kind code	B2
Filing date	Jan 24, 2020
Priority date	Jan 28, 2019
Publication date	Feb 8, 2022
Grant date	Feb 8, 2022

Abstract

A control method for a head-mounted visual apparatus, a corresponding computing apparatus, a head-mounted visual apparatus and a computer-readable storage medium. The head-mounted visual apparatus has an infrared transceiver including an infrared light source array and an infrared detector. The control method comprises the steps of: driving each sub-light source to emit coherent infrared light to form an interference enhanced scanning light spot on a face of a user who wears the head-mounted visual apparatus; controlling each phase of the coherent infrared light emitted by each sub-light source respectively to make the scanning light spot move in the local area, including eyes, of the face of the user, to realize a scanning of the local area; and using the infrared detector to receive the infrared light reflected from the local area to generate scanning data.

First claim

What is claimed is:

1. A control method for a head-mounted visual apparatus, wherein the head-mounted visual apparatus comprises an infrared transceiver, the infrared transceiver comprises an infrared light source array and an infrared detector, the infrared light source array comprises a plurality of sub-light sources, the plurality of sub-light sources are arranged to form multiple rows and multiple columns of the infrared light source array, each of the plurality of sub-light sources is configured to emit coherent infrared light, and the control method comprises steps of:
driving each sub-light source to emit coherent infrared light to form an interference enhanced scanning light spot on a face of a user who wears the head-mounted visual apparatus;
establishing a two-dimensional rectangular reference coordinate system in a field of vision of the infrared detector, wherein the two-dimensional rectangular reference coordinate system comprises a first axis and a second axis that are perpendicular to each other;
controlling each phase of the coherent infrared light emitted by each sub-light source respectively to make the scanning light spot move according to the two-dimensional rectangular reference coordinate system to scan each line extending along the first axis point by point and scan all lines along the second axis sequentially, thereby realizing a two-dimensional scanning of a local area, including eyes, of the face of the user; and
using the infrared detector to receive the infrared light reflected from the local area to generate scanning data.

2. The control method according to claim 1 , wherein the control method further comprises a step of:
determining positions of the pupil centers of the user's eyes based on the scanning data.

3. The control method according to claim 2 , wherein the step of determining the positions of the pupil centers of the user's eyes based on the scanning data comprises:
generating a three-dimensional image of the local area based on the scanning data;
comparing the three-dimensional image with facial features to determine the positions of the eyes; and
determining the positions of the pupil centers based on the positions of the eyes.

4. The control method according to claim 3 , wherein the infrared detector comprises a detector array composed of a plurality of sub-detectors, the scanning data records a distribution on the detector array of the infrared light reflected from the local area, and the step of generating a three-dimensional image of the local area based on the scanning data comprises:
obtaining depth information of each part of the local area based on the distribution; and
generating the three-dimensional image based on the depth information of each part of the local area.

5. The control method according to claim 3 , wherein the step of comparing the three-dimensional image with facial features to determine the positions of the eyes comprises:
identifying graphic features of eye corners in the three-dimensional image; and
determining the positions of the eyes based on the identified graphic features of the eye corners.

6. The control method according to claim 2 , wherein the step of determining positions of the pupil centers of the user's eyes based on the scanning data comprises:
determining an infrared light reflection intensity of each part of the local area based on the scanning data; and
determining the positions of the pupil centers based on the infrared light reflection intensity of each part of the local area.

7. The control method according to claim 2 , wherein the head-mounted visual apparatus further comprises a first lens device and a second lens device configured to correspond to the user's eyes so that the user may watch via the first lens device and the second lens device, and the head-mounted visual apparatus further comprises an adjustment device configured to adjust positions of the first lens device and the second lens device, and the control method further comprises a step of:
adjusting a position of at least one of the first lens device and the second lens device by the adjustment device based on the positions of the pupil centers, so that the optical centers of the first lens device and the second lens device are respectively aligned with the corresponding pupil centers.

8. The control method according to claim 7 , wherein the control method further comprises:
adjusting a distance from an optical center of at least one of the first lens device and the second lens device to one of the pupil centers correspondingly.

9. The control method according to claim 7 , wherein the head-mounted visual apparatus further comprises a first display screen and a second display screen, the adjustment device is further configured to adjust positions of displaying areas in the first display screen and the second display screen, and the control method further comprises:
adjusting a position of a displaying area in at least one of the first display screen and the second display screen by the adjustment device, so that the center of the displaying area in the first display screen is aligned with the optical center of the first lens device, and the center of the displaying area in the second display screen is aligned with the optical center of the second lens device.

10. The control method according to claim 9 , wherein the control method further comprises:
adjusting a distance from the center of the displaying area in at least one of the first display screen and the second display screen to the optical center of one of the first lens device and the second lens device correspondingly.

11. A head-mounted visual apparatus comprising:
an infrared transceiver comprising an infrared light source array and an infrared detector, wherein the infrared light source array comprising a plurality of sub-light sources, the plurality of sub-light sources are arranged to form multiple rows and multiple columns of the infrared light source array, each of the plurality of sub-light sources is configured to emit coherent infrared light;
a memory configured to store a computer program; and
a processor configured to execute the computer program to realize a control method for the head-mounted visual apparatus, the control method comprising steps of:
driving each sub-light source to emit coherent infrared light to form an interference enhanced scanning light spot on a face of a user who wears the head-mounted visual apparatus;
establishing a two-dimensional rectangular reference coordinate system in a field of vision of the infrared detector, wherein the two-dimensional rectangular reference coordinate system comprises a first axis and a second axis that are perpendicular to each other;
controlling each phase of the coherent infrared light emitted by each sub-light source respectively to make the scanning light spot move according to the two-dimensional rectangular reference coordinate system to scan each line extending along the first axis point by point and scan all lines along the second axis sequentially, thereby realizing a two-dimensional scanning of a local area, including eyes, of the face of the user; and
using the infrared detector to receive the infrared light reflected from the local area to generate scanning data.

12. The head-mounted visual apparatus according to claim 11 , wherein the control method further comprises a step of:
determining positions of the pupil centers of the user's eyes based on the scanning data.

13. The head-mounted visual apparatus according to claim 12 , wherein the step of determining the positions of the pupil centers of the user's eyes based on the scanning data

Assignees

• Beijing Boe Optoelectronics Tech Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Lu Yuanjie
• Li Xi
• Zhang Hao
• Chen Lili
• Han Peng
• Lei Yu
• He Huidong

Classifications

• G02B27/0176

  characterised by mechanical features · CPC title

• G02B27/0087

  Phased arrays · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title