Vision system for teat detection

Patent metadata

Field	Value
Publication number	US-10349613-B2
Application number	US-201715448854-A
Country	US
Kind code	B2
Filing date	Mar 3, 2017
Priority date	Aug 17, 2016
Publication date	Jul 16, 2019
Grant date	Jul 16, 2019

Abstract

A system includes a robotic arm, a laser, and a processor. The processor is configured to command the robotic arm to move to a first location corresponding to an expected teat position of a first teat. The processor is further configured to determine whether the first teat is found in a first scan by the laser, and if so, command the robotic arm to move to a second location corresponding to the location in the scan. The processor is further configured to determine whether the first teat is found in a second scan by the laser, and if so, determine whether the first teat is within a predetermined distance from a current location of the robotic arm. If the first teat is within the predetermined distance from the current location of the robotic arm, the processor commands the robotic arm to attach a teat cup to the first teat.

First claim

The invention claimed is:

1. A vision system comprising:
a robotic arm configured to attach a teat cup to a dairy livestock in a stall;
a laser coupled to the robotic arm and configured to generate a plurality of profile signals, each profile signal comprising information associated with a relative distance between the laser and at least a portion of the dairy livestock;
one or more memory devices configured to store historical teat location information for a plurality of teats of the dairy livestock; and
a processor communicatively coupled to the laser and the one or more memory devices, the processor configured to:
determine, from the historical teat location information, an expected teat position associated with a first teat;
command the robotic arm to move to a first location corresponding to the expected teat position;
command the robotic arm to move up a predetermined amount after the robotic arm moves to the first location corresponding to the expected teat position;
command the laser to perform a first scan of the dairy livestock after the robotic arm moves up the predetermined amount;
access a first profile signal generated by the laser from the first scan;
determine that the first teat is found in the first profile signal, the first teat located at a first scan location within the first profile signal;
after determining that the first teat is found in the first profile signal, command the robotic arm to move to a second location corresponding to the first scan location;
command the laser to perform a second scan of the dairy livestock after the robotic arm moves to the second location;
access a second profile signal generated by the laser from the second scan;
determine that the first teat is found in the second profile signal, the first teat located at a second scan location within the second profile signal;
after determining that the first teat is found in the second profile signal, determine that the first teat is within a predetermined distance from a current location of the robotic arm; and
after determining that the first teat is within the predetermined distance from the current location of the robotic arm, command the robotic arm to attach the teat cup to the first teat.

2. The vision system of claim 1 , wherein the predetermined amount is less than or equal to 5 mm.

3. The vision system of claim 1 , wherein the predetermined distance is less than or equal to 2 mm.

4. The vision system of claim 1 , wherein the processor is further configured to:
determine that the first teat is not found in the first profile signal; and
after determining that the first teat is not found in the first profile signal:
command the robotic arm to move up the predetermined amount; and
command the laser to perform the first scan of the dairy livestock again.

5. The vision system of claim 1 , wherein the processor is further configured to:
determine that the first teat is not found in the second profile signal; and
after determining that the first teat is not found in the second profile signal, command the robotic arm to move back to the first location corresponding to the expected teat position.

6. The vision system of claim 1 , wherein the processor is further configured to:
after determining that the first teat is found in the second profile signal, determine that the first teat is not within the predetermined distance from the current location of the robotic arm; and
after determining that the first teat is not within the predetermined distance from the current location of the robotic arm, command the robotic arm to move back to the second location corresponding to the first scan location.

7. A method, comprising:
determining, by a processor from historical teat location information for a plurality of teats of a dairy livestock, an expected teat position associated with a first teat of the dairy livestock;
commanding, by the processor, a robotic arm to move to a first location corresponding to the expected teat position;
commanding, by the processor, the robotic arm to move up a predetermined amount after the robotic arm moves to the first location corresponding to the expected teat position;
commanding, by the processor, a laser to perform a first scan of the dairy livestock after the robotic arm moves up the predetermined amount;
accessing, by the processor, a first profile signal generated by the laser from the first scan;
determining, by the processor, that the first teat is found in the first profile signal, the first teat located at a first scan location within the first profile signal;
after determining that the first teat is found in the first profile signal, commanding, by the processor, the robotic arm to move to a second location corresponding to the first scan location;
commanding, by the processor, the laser to perform a second scan of the dairy livestock after the robotic arm moves to the second location;
accessing, by the processor, a second profile signal generated by the laser from the second scan;
determining, by the processor, that the first teat is found in the second profile signal, the first teat located at a second scan location within the second profile signal;
after determining that the first teat is found in the second profile signal, determining, by the processor, that the first teat is within a predetermined distance from a current location of the robotic arm; and
after determining that the first teat is within the predetermined distance from the current location of the robotic arm, commanding, by the processor, the robotic arm to attach a teat cup to the first teat.

8. The method of claim 7 , wherein the predetermined amount is less than or equal to 5 mm.

9. The method of claim 7 , wherein the predetermined distance is less than or equal to 2 mm.

10. The method of claim 7 , further comprising:
determining, by the processor, that the first teat is not found in the first profile signal; and
after determining that the first teat is not found in the first profile signal:
commanding, by the processor, the robotic arm to move up the predetermined amount; and
commanding, by the processor, the laser to perform the first scan of the dairy livestock again.

11. The method of claim 7 , further comprising:
determining, by the processor, that the first teat is not found in the second profile signal; and
after determining that the first teat is not found in the second profile signal, commanding, by the processor, the robotic arm to move back to the first location corresponding to the expected teat position.

12. The method of claim 7 , wherein the processor is further configured to:
after determining that the first teat is found in the second profile signal, determining, by the processor, that the first teat is not within the predetermined distance from the current location of the robotic arm; and
after determining that the first teat is not within the predetermined distance from the current location of the robotic arm, commanding, by the processor, the robotic arm to move back to the second location corresponding to the first scan location.

13. One or more computer-readable non-transitory storage media comprising software instructions, the software instructions, when executed by one or more processors, cause the one or more processors to:
command a robotic arm to move to a first location corresponding to an expected teat position associated with a first teat of a dairy livestock;
command the robotic arm to move up a predetermined amount after the robotic arm has moved to the first location;
command a laser to perform a first scan of the dairy livestock;
determine that the fi

Assignees

• Technologies Holdings Corp

Inventors

• Foresman Mark A
• Van Anart Marijn

Classifications

• A01J5/0175 Primary

  Attaching of clusters · CPC title

• A01J5/007 Primary

  Monitoring milking processes; Control or regulation of milking machines · CPC title

• G01B11/24

  for measuring contours or curvatures · CPC title