Flexible optical finger tracking sensor system

Patent metadata

Field	Value
Publication number	US-12229348-B2
Application number	US-202218091463-A
Country	US
Kind code	B2
Filing date	Dec 30, 2022
Priority date	Dec 30, 2022
Publication date	Feb 18, 2025
Grant date	Feb 18, 2025

Abstract

A system, for tracking fingers of a hand, includes: a sensor patch and a processor. The sensor patch includes: a flexible substrate layer; a light emitting layer attached to the flexible substrate layer; and a photodiode disposed between the light emitting layer a surface of the sensor patch that contacts the hand. The light emitting layer is configured to conform to a skin surface of a backside of the hand and to emit a first wavelength of light. The processor is configured to: control emission of the first wavelength of light by the light emitting layer; analyze backscattered light intensities from the skin surface of the backside of the hand that are detected by the photodiode; determine finger pose information based on the backscattered light intensities; and transmit the finger pose information.

First claim

What is claimed is:

1. A system for tracking fingers of a hand, the system comprising:
a sensor patch comprising:
a flexible substrate layer;
a light emitting layer attached to the flexible substrate layer, wherein
the light emitting layer is configured to conform to a skin surface of a backside of the hand and to emit a first wavelength of light; and

a photodiode disposed between the light emitting layer and a surface of the sensor patch that contacts the hand; and

a processor configured to:
control emission of the first wavelength of light by the light emitting layer;
analyze backscattered light intensities from the skin surface of the backside of the hand that are detected by the photodiode;
determine finger pose information based on the backscattered light intensities; and
transmit the finger pose information.

2. The system of claim 1 , wherein
the sensor patch includes a plurality of photodiodes and a position of each photodiode correspond to a metacarpal bone of the hand.

3. The system of claim 2 , wherein
the sensor patch further comprises a sectioning mask disposed between the photodiode and the surface of the sensor patch that contacts the hand, and
the sectioning mask prevents detection of stray light by the photodiode.

4. The system of claim 1 , wherein
the light emitting layer is an organic light emitting diode sheet configured to operate with a continuous mode or a duty cycle of 50% or less.

5. The system of claim 4 , wherein
the organic light emitting diode sheet is configured to emit the first wavelength of light and a second wavelength of light at different times,
the photodiode is configured to detect the first wavelength of light and the second wavelength of light.

6. The system of claim 4 , wherein
the organic light emitting diode sheet comprises a shadow mask that corresponds to a position of the photodiode, and
the shadow mask prevents light emitted by the adjacent light emitting layer reaching to the photodiode.

7. The system of claim 1 , wherein
the flexible substrate layer includes a single-sided medical-grade adhesive tape that is configured to attach the sensor patch to the backside of the hand and conform the light emitting layer to the backside of the hand.

8. The system of claim 1 , wherein
the flexible substrate layer includes an elastic band or a flexible clamp that is configured to attach the sensor patch to the backside of the hand and conform the light emitting layer to the backside of the hand.

9. The system of claim 1 , further comprises
a connector patch electrically connects the sensor patch to a wearable wristband device, and
the wearable wristband device includes the processor and a transceiver for communicating with a user device.

10. A method for tracking fingers of a hand, the method comprising:
attaching a sensor patch to a skin surface of a backside of the hand, wherein
the sensor patch includes a flexible substrate layer, a light emitting layer attached to the flexible substrate layer, and a photodiode disposed between the light emitting layer and a surface of the sensor patch that contacts the hand, and
the light emitting layer conforms to the backside of the hand;

emitting, by the light emitting layer, a first wavelength of light into the hand;
detecting backscattered light intensities from the skin surface of the backside of the hand with the photodiode;
analyzing, by a processor that is coupled to the light emitting layer and the photodiode, the backscattered light intensities from the skin surface of the backside of the hand;
determining, by the processor, finger pose information based on the backscattered light intensities; and
transmitting the finger pose information.

11. The method of claim 10 , wherein
the sensor patch includes a plurality of photodiodes, and
attaching the sensor patch includes aligning the plurality of photodiodes at positions that correspond to metacarpal bones of the hand.

12. The method of claim 10 , wherein
the detecting of the backscattered light intensities from the skin surface of the backside of the hand includes spatially filtering the backscattered light intensities with a sectioning mask, and
the sectioning mask prevents detection of stray light by the photodiode.

13. The method of claim 10 , wherein
the first wavelength of light is emitted by an organic light emitting diode sheet operating with a continuous mode or a duty cycle of 50% or less.

14. The method of claim 13 , further includes
emitting, by the light emitting layer, a second wavelength of light into the hand, wherein
the first wavelength of light and the second wavelength of light are emitted at different times.

15. The method of claim 13 , wherein
light emitted by the adjacent light emitting layer is prevented from reaching the photodiode by a shadow mask, and
the shadow mask is attached to the organic light emitting diode sheet at a position corresponding to the photodiode.

16. A non-transitory computer readable medium (CRM) storing computer readable program code for tracking fingers of a hand, the computer readable program code causes a processor to:
control emission of a first wavelength of light into the hand by a sensor patch attached to a skin surface of a backside of the hand, wherein
the sensor patch includes a flexible substrate layer, a light emitting layer attached to the flexible substrate layer, and a photodiode disposed between the light emitting layer and a surface of the sensor patch that contacts the hand, and
the light emitting layer conforms to the backside of the hand;

detect backscattered light intensities from the skin surface of the backside of the hand with the photodiode;
analyze the backscattered light intensities from the skin surface of the backside of the hand;
determine finger pose information based on the backscattered light intensities; and
transmit the finger pose information.

17. The non-transitory CRM of claim 16 , wherein
the computer readable program code causes the processor to control the emission of the first wavelength of light by operating an organic light emitting diode sheet with a continuous mode or duty cycle of 50% or less.

18. The non-transitory CRM of claim 17 , wherein
the computer readable program code causes the processor to control emission of a second wavelength of light into the hand by the light emitting layer, wherein
the first wavelength of light and the second wavelength of light are emitted at different times.

19. The non-transitory CRM of claim 16 , wherein
in determining the finger pose information, the processor uses a machine learning model that includes a deep learning neural network.

20. The non-transitory CRM of claim 19 , wherein
the computer readable program code further causes the processor to:
obtain training data by emitting the first wavelength of light into the hand and detecting the backscattered light intensities during known finger poses;
use a machine learning algorithm to train the deep learning neural network with the training data and known finger poses as inputs.

Assignees

• Konica Minolta Business Solutions Usa Inc

Inventors

• Amano Jun

Classifications

• G06F3/014

  Hand-worn input/output arrangements, e.g. data gloves · CPC title

• G06N3/091

  Active learning · CPC title

• G06F3/0304 Primary

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title