Vision system for teat detection

Patent metadata

Field	Value
Publication number	US-10349615-B2
Application number	US-201715448914-A
Country	US
Kind code	B2
Filing date	Mar 3, 2017
Priority date	Aug 17, 2016
Publication date	Jul 16, 2019
Grant date	Jul 16, 2019

Abstract

A system includes a robotic arm, a laser, and a processor. The processor is configured to command the robotic arm to move to a location of an expected teat position of a dairy livestock and to command the laser to perform two scans of the dairy livestock. The processor is further configured to determine whether a first teat is found in both of the scans, and if so, determine whether locations of the first teat in the two scans are within a predetermined distance of each other. The processor is further configured to, in response to determining that locations of the first teat in the two scans are within the predetermined distance of each other, command the robotic arm to move to a location corresponding to the location of the first teat and to command the robotic arm to attach a teat cup to the first teat.

First claim

The invention claimed is:

1. A vision system comprising:
a robotic arm configured to attach a teat cup to a dairy livestock in a stall;
a laser coupled to the robotic arm and configured to generate a plurality of profile signals, each profile signal comprising information associated with a relative distance between the laser and at least a portion of the dairy livestock;
one or more memory devices configured to store historical teat location information for a plurality of teats of the dairy livestock; and
a processor communicatively coupled to the laser and the one or more memory devices, the processor configured to:
determine, from the historical teat location information, an expected teat position associated with a first teat;
command the robotic arm to move to a first location corresponding to the expected teat position;
command the laser to perform first and second scans of the dairy livestock after the robotic arm moves to the first location corresponding to the expected teat position;
access a first profile signal and a second profile signal generated, respectively, by the laser from the first and second scans;
determine that the first teat is found in both the first and second profile signals;
in response to determining that the first teat is found in both the first and second profile signals, determine that first scan locations of the first teat in the first and second profile signals are within a predetermined distance of each other;
in response to determining that the first scan locations of the first teat in the first and second profile signals are within the predetermined distance of each other, command the robotic arm to move to a second location corresponding to the first scan locations of the first teat in the first and second profile signals;
command the laser to perform third and fourth scans of the dairy livestock after the robotic arm moves to the second location;
access a third profile signal and a fourth profile signal generated, respectively, by the laser from the third and fourth scans;
determine that the first teat is found in both the third and fourth profile signals;
in response to determining that the first teat is found in both the third and fourth profile signals, determine that second scan locations of the first teat in the third and fourth profile signals are within the predetermined distance of each other; and
in response to determining that the second scan locations of the first teat in the third and fourth profile signals are within the predetermined distance of each other, command the robotic arm to attach the teat cup to the first teat.

2. The vision system of claim 1 , wherein the predetermined distance is less than or equal to 5 mm.

3. The vision system of claim 1 , wherein the processor is further configured to:
determine that the first teat is not found in both the first and second profile signals;
in response to determining that the first teat is not found in both the first and second profile signals, command the robotic arm to move up a predetermined amount; and
command the laser to perform the first and second scans of the dairy livestock again after the robotic arm moves up the predetermined amount.

4. The vision system of claim 3 , wherein the predetermined amount is less than or equal to 5 mm.

5. The vision system of claim 1 , wherein the processor is further configured to:
determine that the first scan locations of the first teat in the first and second profile signals are not within the predetermined distance of each other;
in response to determining that the first scan locations of the first teat in the first and second profile signals are not within the predetermined distance of each other, command the robotic arm to move up a predetermined amount; and
command the laser to perform the first and second scans of the dairy livestock again after the robotic arm moves up the predetermined amount.

6. The vision system of claim 1 , wherein the processor is further configured to:
determine that the first teat is not found in both the third and fourth profile signals;
in response to determining that the first teat is not found in both the third and fourth profile signals, command the robotic arm to move up a predetermined amount; and
command the laser to perform the first and second scans of the dairy livestock again after the robotic arm moves up the predetermined amount.

7. The vision system of claim 1 , wherein the processor is further configured to:
determine that the second scan locations of the first teat in the third and fourth profile signals are not within the predetermined distance of each other;
in response to determining that the second scan locations of the first teat in the third and fourth profile signals are not within the predetermined distance of each other, command the robotic arm to move up a predetermined amount; and
command the laser to perform the first and second scans of the dairy livestock again after the robotic arm moves up the predetermined amount.

8. A method, comprising:
determining, by a processor from historical teat location information for a plurality of teats of a dairy livestock, an expected teat position associated with a first teat of the dairy livestock;
commanding, by the processor, a robotic arm to move to a first location corresponding to the expected teat position;
commanding, by the processor, a laser on the robotic arm to perform first and second scans of the dairy livestock after the robotic arm moves to the first location corresponding to the expected teat position;
accessing, by the processor, a first profile signal and a second profile signal generated, respectively, by the laser from the first and second scans;
determining, by the processor, that the first teat is found in both the first and second profile signals;
in response to determining that the first teat is found in both the first and second profile signals, determining, by the processor, that first scan locations of the first teat in the first and second profile signals are within a predetermined distance of each other;
in response to determining that the first scan locations of the first teat in the first and second profile signals are within the predetermined distance of each other, commanding, by the processor, the robotic arm to move to a second location corresponding to the first scan locations of the first teat in the first and second profile signals;
commanding, by the processor, the laser to perform third and fourth scans of the dairy livestock after the robotic arm moves to the second location;
accessing, by the processor, a third profile signal and a fourth profile signal generated, respectively, by the laser from the third and fourth scans;
determining, by the processor, that the first teat is found in both the third and fourth profile signals;
in response to determining that the first teat is found in both the third and fourth profile signals, determining, by the processor, that second scan locations of the first teat in the third and fourth profile signals are within the predetermined distance of each other; and
in response to determining that the second scan locations of the first teat in the third and fourth profile signals are within the predetermined distance of each other, commanding, by the processor, the robotic arm to attach the teat cup to the first teat.

9. The method of claim 8 , wherein the predetermined distance is less than or equal to 5 mm.

10. The method of claim 8 , further comprising:
determining, by the processor, that the first teat is not found in both the first and second profile signals;
in response to determining that the first teat is not found in both the first and second pro

Assignees

• Technologies Holdings Corp

Inventors

• Foresman Mark A
• Prevost Bradley J

Classifications

• A01J5/007 Primary

  Monitoring milking processes; Control or regulation of milking machines · CPC title

• G01B11/24

  for measuring contours or curvatures · CPC title

• A01J5/0175

  Attaching of clusters · CPC title

• G06K9/00664

  Physics · mapped topic

• G06V20/10

  Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) · CPC title