Visual feedback controller

Patent metadata

Field	Value
Publication number	US-2023196614-A1
Application number	US-202017926641-A
Country	US
Kind code	A1
Filing date	Jul 7, 2020
Priority date	Jul 7, 2020
Publication date	Jun 22, 2023
Grant date	—

Abstract

A visual feedback controller includes: a camera that outputs a target object image; a template image storage unit that stores a template image; an image processing unit that uses the target object image and the template image to measure an actual position of a target object with subpixel accuracy, and outputs the measured actual position as an image processing measurement value; a drive command generation unit that generates a drive command signal; an error compensation control unit that compensates an error of the drive command signal using the image processing measurement value and generates a drive compensation signal; a machine drive unit that changes a position of a machine tip relative to the target object based on the drive compensation signal; and a template image analysis unit that analyzes the template image, calculates measurement accuracy of the image processing measurement value, and outputs the calculated measurement accuracy.

First claim

1 . A visual feedback controller to control a positioning operation that positions a machine tip at a position of a target object, the visual feedback controller comprising:
a camera to capture an image of the target object and output the captured image as a target object image; a template image storage to store a template image obtained by capturing an image of the target object in advance; processing circuitry to use the target object image and the template image to measure an actual position of the target object with subpixel accuracy, which provides a higher accuracy than a size of a pixel in the target object image and the template image, and output the measured actual position as an image processing measurement value; to generate a drive command signal that is a command for controlling a positioning operation of a machine driver to which the machine tip is connected; and to compensate an error of the drive command signal using the image processing measurement value such that the machine tip is positioned at the position of the target object, and generate a drive compensation signal; and the machine driver to change a position of the machine tip relative to the target object on the basis of the drive compensation signal; wherein the processing circuitry generates an analysis image obtained by shifting the template image by an amount having a decimal value with respect to one pixel of the template image; uses the analysis image and the template image to measure an amount of deviation between the analysis image and the template image by using the target object image and the template image to measure an actual position of the target object with the subpixel accuracy, and outputs the amount of deviation as a calculated deviation; and calculates the image processing accuracy analytical value from an amount of shift of the analysis image with respect to the template image and the calculated deviation.

2 . (canceled)

3 . The visual feedback controller according to claim 1 , comprising
an analysis template image storage to store an analysis template image captured by shifting an imaging range of the template image by a prescribed distance, wherein
the processing circuitry uses the template image and the analysis template image to output the calculated deviation.

4 . The visual feedback controller according to claim 1 , comprising
a high-pixel template image storage to store a high-pixel template image that is an image obtained by capturing an image of a range wider than an imaging range of the template image, and is an image captured with a higher resolution than the template image, wherein
the processing circuitry uses the template image and the high-pixel template image to output the calculated deviation.

5 . The visual feedback controller according to claim 1 , comprising:
a high-pixel template image storage to store a high-pixel template image that is an image obtained by capturing an image of a range wider than an imaging range of the template image, and is an image captured with a higher resolution than the template image; and wherein
the processing circuitry generates the template image from the high-pixel template image,
the template image storage stores the template image generated, and
the processing circuitry uses the template image and the high-pixel template image to output the calculated deviation.

6 . The visual feedback controller according to claim 5 , wherein
the processing circuitry generates a plurality of candidate template images, which is to be candidates of the template image, from the high-pixel template image on the basis of the image processing accuracy analytical value, outputs the measurement accuracy of the image processing measurement value, which is calculated using each of the plurality of the candidate template images and the high-pixel template image, as the image processing accuracy analytical value corresponding to each of the candidate template images, and as the template image, the candidate template image corresponding to the image processing measurement value with the highest measurement accuracy, on the basis of the image processing accuracy analytical value.

7 . The visual feedback controller according to claim 1 , wherein
the processing circuitry determines a resolution of the image processing measurement value to be output on the basis of the image processing accuracy analytical value.

8 . The visual feedback controller according to claim 3 , wherein
the processing circuitry determines a resolution of the image processing measurement value to be output on the basis of the image processing accuracy analytical value.

9 . The visual feedback controller according to claim 4 , wherein
the processing circuitry determines a resolution of the image processing measurement value to be output on the basis of the image processing accuracy analytical value.

10 . The visual feedback controller according to claim 5 , wherein
the processing circuitry determines a resolution of the image processing measurement value to be output on the basis of the image processing accuracy analytical value.

11 . The visual feedback controller according to claim 6 , wherein
the processing circuitry determines a resolution of the image processing measurement value to be output on the basis of the image processing accuracy analytical value.

Assignees

• Mitsubishi Electric Corp

Inventors

• Sekiguchi Hiroyuki
• Kawata Takeyuki

Classifications

• G06T7/74 Primary

  involving reference images or patches · CPC title

• G05B2219/32368

  Quality control · CPC title

• G06T1/0014

  Image feed-back for automatic industrial control, e.g. robot with camera (robots B25J19/023) · CPC title

• G05B19/41875

  characterised by quality surveillance of production · CPC title

• G06T1/60

  Memory management · CPC title