Heterogeneous chiplet ID using photoluminescence in uASSEMBLER system

Patent metadata

Field	Value
Publication number	US-12498329-B2
Application number	US-202318529372-A
Country	US
Kind code	B2
Filing date	Dec 5, 2023
Priority date	Dec 5, 2023
Publication date	Dec 16, 2025
Grant date	Dec 16, 2025

Abstract

A machine vision system and method uses photoluminescence light response of micro-LEDs to identify types of micro-LEDs (e.g., red, green, or blue) that are used to assemble a micro-LED display. Excitation light (e.g., ultraviolet excitation light) in a certain wavelength range is illuminated on a random pool of heterogeneous micro-LEDs consisting of materials, for example, that photoluminesce in three different colors-red, green, or blue. The micro-LED is optically excited and will emit either red, green, or blue, photoluminescence light based on the type of the micro-LED. The machine vision system uses a camera device that includes color response sensors to differentiate the type of micro-LED. The orientation of the micro-LED can also be detected. The machine vision system, based on the type, location, and orientation of the heterogeneous micro-LEDs, provides image-data based optical feedback to a microassembler system to move the micro-LEDs on a planar working surface according to an electrostatic template.

First claim

What is claimed is:

1 . A method with a machine vision system for providing optical feedback signals to a microassembler system in a microassembly process, the method comprising:
selectively turning ON a first excitation light source selected from a plurality of excitation light sources including the first excitation light source and a second excitation light source, each of the plurality of excitation light sources being respectively optically coupled to an excitation light source optical train; optically coupling first excitation light from the selected first excitation light source into an excitation light source optical train optically coupled thereto, and passing and directing first emitted excitation light in a first defined excitation light wavelength range from the excitation light source optical train to illuminate an individual optical module field-of-view (FOV) region, also referred to as a module FOV region, on a planar working surface of a microassembler backplane; receiving, by a receiving optical train while the selected first excitation light source is ON, light from the module FOV region, the received light including photoluminescence light signals emitted from one or more micro-LEDs in the module FOV region, and capturing a first image of the received light including the photoluminescence light signals; selectively turning ON the second excitation light source and turning OFF the first excitation light source; optically coupling second excitation light from the selected second excitation light source into an excitation light source optical train optically coupled thereto, and passing and directing emitted second excitation light from the excitation light source optical train in a second defined excitation light wavelength range, different from the first defined excitation light wavelength range, to illuminate the module FOV region; receiving, by the receiving optical train while the selected second excitation light source is ON, light from the module FOV region, the received light including photoluminescence light signals emitted from the one or more micro-LEDs in the module FOV region, and capturing a second image of the received light including the photoluminescence light signals; and performing image processing on at least one of the captured first image and the captured second image, and comparing the captured first image to the captured second image to identify at least one of: a location, an orientation, or a type, of at least one micro-LED of the one or more micro-LEDs in the module FOV region.

2 . The method of claim 1 , wherein the performing image processing includes overlaying the captured first image and the captured second image to generate a composite image of the module FOV region, and the comparing comprises comparing the captured first image in the composite image to the captured second image in the composite image, to identify at least one of: a location, an orientation, or a type, of each of the one or more micro-LEDs in the module FOV region.

3 . The method of claim 1 , wherein the one or more micro-LEDs include at least one red micro-LED, green micro-LED, or blue-micro-LED, and the first defined excitation light wavelength range of the first excitation light is selected from a plurality of defined different excitation light wavelength ranges to excite quantum well material in the at least one red, green, or blue, micro-LED, and in response to being excited by the first excitation light the red, green, or blue, micro-LED emits photoluminescence light in a wavelength range matching a defined wavelength range of photoluminescence light emission from each of a red, green, or blue, micro-LED, and the method comprising:
receiving, by the receiving optical train while the selected first excitation light source is ON and illuminating the one or more micro-LEDs with the first excitation light in the first defined excitation light wavelength range, light from the module FOV region, the received light including photoluminescence light signals emitted from the at least one red micro-LED, green micro-LED, or blue-micro-LED, and capturing the first image, with a camera device, of received light including the photoluminescence light signals.

4 . The method of claim 1 , comprising:
selectively turning ON an illumination light source and turning OFF the second excitation light source, optically coupling visible white or NIR illumination light from the illumination light source into an illumination light source optical train, and directing emitted visible white illumination light from the illumination light source optical train to illuminate the module FOV region; receiving, by the receiving optical train while the illumination light source is ON, light from the module FOV region, the received light including reflected visible white or NIR illumination light signals reflected from the one or more micro-LEDs in the module FOV region, and capturing a third image of the received light including the reflected visible white or NIR illumination light signals; and performing image processing on at least one of the first captured image, the second captured image, or the third captured image, and comparing the captured third image to the captured second image and the captured first image, to identify at least one of: a location, an orientation, or a type of, each of the one or more micro-LEDs in the module FOV region.

5 . The method of claim 1 , comprising:
determining, based on the comparing, an identification of at least one of a location, an orientation, or a type, of at least one micro-LED in the one or more micro-LEDs in the module FOV region on the planar working surface.

6 . The method of claim 5 , comprising:
providing image-data based optical feedback signals from the machine vision system to a microassembler system as part of a microassembly process, the image-data based optical feedback signals including at least one of the identified location, the identified orientation, or the identified type, of the at least one micro-LED in the one or more micro-LEDs disposed in the module FOV region on the planar working surface.

7 . The method of claim 5 , wherein the determining comprises:
determining an identification of a location of a cathode and/or an anode of the at least one micro-LED in the module FOV region, and determining an identification of a horizontal orientation of the at least one micro-LED in the module FOV region, based on the identification of the location of a cathode and/or an anode of the at least one micro-LED.

8 . The method of claim 5 , wherein at least one micro-LED in the one or more micro-LEDs includes a fluorescent material dot embedded into a surface of an outer layer of the micro-LED, and the method comprises:
receiving, by the receiving optical train while the excitation light source is ON, light from the module FOV region, the received light including fluorescence light signals in a certain defined fluorescence wavelength range which are emitted from the fluorescent material dot in the surface of the micro-LED, and capturing the first image of the received light including the fluorescence light signals; and determining, based on the comparing, that the captured first image includes emitted fluorescence light in the certain defined fluorescence wavelength range and thereby identification of vertical orientation of the at least one micro-LED in the module FOV region on the planar working surface.

9 . A method for operating a machine vision system for use with a microassembler system for inspection of assembly of micro-objects on a planar working surface, the method comprising:
providing an individual optical-image-capture module including a receiving optical train and a

Assignees

• Xerox Corp
• Genesee Valley Innovations Llc

Inventors

• Ping Lu Jeng
• Raychaudhuri Sourobh
• Chow Eugene Michael
• Wunderer Thomas
• Maeda Patrick Yasuo

Classifications

• G01N21/95 Primary

  characterised by the material or shape of the object to be examined (G01N21/89 - G01N21/91, G01N21/94 take precedence) · CPC title

• G01N2021/8835

  Adjustable illumination, e.g. software adjustable screen · CPC title

• G01N2021/8887

  based on image processing techniques · CPC title

• G06T2207/10064

  Fluorescence image · CPC title

• G06T7/001

  using an image reference approach · CPC title