Head mounted display device and control method for eye-tracking operation

Patent metadata

Field	Value
Publication number	US-12323710-B2
Application number	US-202318149156-A
Country	US
Kind code	B2
Filing date	Jan 3, 2023
Priority date	Mar 29, 2022
Publication date	Jun 3, 2025
Grant date	Jun 3, 2025

Abstract

A head-mounted display device and a control method for an eye-tracking operation are provided. The head-mounted display device includes a frame, a track, a sensor and a controller. The track is disposed on a peripheral region of the frame. The sensor is disposed on the track, and is configured to capture a target image of a target area. The controller is coupled to the sensor, is configured to generate a control signal according to the target image, and adjust a position of the sensor on the peripheral region by moving the sensor according to the control signal.

First claim

What is claimed is:

1. A head-mounted display device, comprising:
a frame;
a track, disposed on a peripheral region of the frame;
a sensor, disposed on the track, is configured to capture a target image of a target area;
an actuator, disposed on the track and connected to the sensor; and
a controller, coupled to the sensor, is configured to generate, after the target image is captured, a control signal according to an area of an eyeball image in the target image,
wherein the actuator moves the sensor on the track according to the control signal to adjust a position of the sensor on the peripheral region
wherein when the sensor moves on the track, the position of the sensor and a view angle for capturing the target area are changed correspondingly, and a fixed relationship between the position and the view angle of the sensor is pre-established as lookup information and provided to the controller,
wherein the controller is configured to obtain the view angle of the sensor according to the position of the sensor.

2. The head-mounted display device according to claim 1 , wherein the controller recognizes whether there is a target object image in the target image to generate an identification information, and the controller generates the control signal according to the identification information.

3. The head-mounted display device according to claim 2 , wherein the controller recognizes whether the target object image in the target image is complete and clear, and when the target object image is not complete and clear, the controller generates the control signal to adjust a position of the sensor.

4. The head-mounted display device according to claim 3 , wherein when the target object image is complete and clear, the controller provides the target image to perform an eye-tracking operation, wherein the target object image is the eyeball image.

5. The head-mounted display device according to claim 1 , further comprises:
a resistor, disposed on the track and electrically connected with the sensor.

6. The head-mounted display device according to claim 5 , wherein the controller or the sensor detects a resistance value between a reference point of the resistor and the sensor to obtain a position information of the sensor.

7. The head-mounted display device according to claim 1 , wherein the controller generates the control signal according to a preset adjustment step value, and adjusts the position of the sensor to move a preset distance according to the preset adjustment step value one or more times.

8. A control method for eye-tracking operation, comprising:
providing a track to be disposed on a peripheral region of a frame of a head-mounted display device;
disposing a sensor on the track, and providing the sensor to capture a target image of a target area; and
providing a controller to generate, after the target image is captured, a control signal according to an area of an eyeball image in the target image;
moving, by an actuator disposed on the track and connected to the sensor, the sensor on the track according to the control signal to adjust a position of the sensor on the peripheral region, wherein when the sensor moves on the track, the position of the sensor and a view angle for capturing the target area are changed correspondingly;
pre-establishing a fixed relationship between the position and the view angle of the sensor as lookup information and providing the lookup information to the controller; and
obtaining, by the controller, the view angle of the sensor according to the position of the sensor.

9. The control method according to claim 8 , wherein the step of providing the controller to generate the control signal according to the target image comprises:
recognizing whether there is a target object image in the target image to generate an identification information by the controller; and
generating the control signal according to the identification information by the controller.

10. The control method according to claim 9 , further comprises:
recognizing whether the target object image in the target image is complete and clear by the controller; and
when the target object image is not complete and clear, generating the control signal to adjust a position of the sensor.

11. The control method according to claim 10 , further comprises:
when the target object image is complete and clear, providing the target image to perform an eye-tracking operation by the controller, wherein the target object image is the eyeball image.

12. The control method according to claim 8 , further comprises:
disposing a resistor on the track, and the resistor is electrically connected with the sensor; and
detecting a resistance value between a reference point of the resistor and the sensor to obtain a position information of the sensor.

13. The control method according to claim 8 , further comprises:
setting a preset adjustment step value; and
adjusting the position of the sensor to move a preset distance according to the preset adjustment step value one or more times.

Assignees

• Htc Corp

Inventors

• Kuo Yan-Min
• Guo Jun-Lin
• Chen Wei-Chen
• Chang Chih-Lin
• Hsu Wei-Cheng
• Chen Cheng-Yu

Classifications

• G06T7/0002

  Inspection of images, e.g. flaw detection · CPC title

• G06T2207/30201

  Face · CPC title

• H04N23/611

  where the recognised objects include parts of the human body · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• G06T2207/30168

  Image quality inspection · CPC title