Vision system for teat detection

Patent metadata

Field	Value
Publication number	US-10499609-B2
Application number	US-201715448821-A
Country	US
Kind code	B2
Filing date	Mar 3, 2017
Priority date	Aug 17, 2016
Publication date	Dec 10, 2019
Grant date	Dec 10, 2019

Abstract

A system includes a robotic arm, a laser, and a processor. The processor is configured to determine whether a first teat of a diary livestock is found in a first scan of the dairy livestock by the laser, and if so, command the robotic arm to move to a location corresponding to the location of the first teat. The processor is further configured to increment a counter associated with the first teat and then determine whether the counter equals a predetermined number. If the counter equals the predetermined number, the processor commands the robotic arm to attach a teat cup to the first teat. If the counter does not equal the predetermined number, the processor determines whether the first teat is found in a second scan by the laser. If the first teat is found in the second scan, the processor commands the robotic arm to attach the teat cup to the first teat.

First claim

The invention claimed is:

1. A vision system comprising:
a robotic arm configured to attach a teat cup to a dairy livestock;
a laser configured to generate a plurality of profile signals, each profile signal comprising information associated with a relative distance between the laser and at least a portion of the dairy livestock;
one or more memory devices operable to store the plurality of profile signals; and
a processor communicatively coupled to the laser and the one or more memory devices, the processor configured to:
access a first profile signal generated by the laser from a first scan;
determine that a first teat is found in the first profile signal, the first teat located at a first scan location within the first profile signal;
in response to determining that the first teat is found in the first profile signal, command the robotic arm to move to a first location corresponding to the first scan location;
increment a counter corresponding to the first teat;
determine whether the counter equals a predetermined number;
in response to determining that the counter equals the predetermined number, command the robotic arm to attach the teat cup to the first teat; and
in response to determining that the counter does not equal the predetermined number:
access a second profile signal generated by the laser from a second scan;
determine that the first teat is found in the second profile signal; and
in response to determining that the first teat is found in the second profile signal, command the robotic arm to attach the teat cup to the first teat.

2. The vision system of claim 1 , wherein the predetermined number is three.

3. The vision system of claim 1 , wherein the processor is further configured to:
determine that the first teat is not found in the first profile signal;
in response to determining that the first teat is not found in the first profile signal, command the robotic arm to move up a predetermined amount; and
after the robotic arm moves up the predetermined amount, command the laser to perform the first scan of the dairy livestock again.

4. The vision system of claim 3 , wherein the predetermined amount is less than or equal to 5 mm.

5. The vision system of claim 1 , wherein the processor is further configured to:
determine that the first teat is not found in the second profile signal; and
in response to determining that the first teat is not found in the second profile signal, command the robotic arm to move back to the first location corresponding to the expected teat position.

6. The vision system of claim 1 , wherein the laser is coupled to the robotic arm.

7. The vision system of claim 1 , wherein the dairy livestock is in a stall.

8. A method, comprising:
accessing, by a processor, a first profile signal generated by a laser from a first scan of a dairy livestock;
determining, by the processor, that a first teat of the dairy livestock is found in the first profile signal, the first teat located at a first scan location within the first profile signal;
in response to determining that the first teat is found in the first profile signal, commanding, by the processor, a robotic arm to move to a first location corresponding to the first scan location;
incrementing, by the processor, a counter corresponding to the first teat;
determining, by the processor, whether the counter equals a predetermined number;
in response to determining that the counter equals the predetermined number, commanding, by the processor, the robotic arm to attach a teat cup to the first teat; and
in response to determining that the counter does not equal the predetermined number:
accessing, by the processor, a second profile signal generated by the laser from a second scan;
determining, by the processor, that the first teat is found in the second profile signal; and
in response to determining that the first teat is found in the second profile signal, commanding, by the processor, the robotic arm to attach the teat cup to the first teat.

9. The method of claim 8 , wherein the predetermined number is three.

10. The method of claim 8 , further comprising:
determining, by the processor, that the first teat is not found in the first profile signal;
in response to determining that the first teat is not found in the first profile signal, commanding, by the processor, the robotic arm to move up a predetermined amount; and
after the robotic arm moves up the predetermined amount, commanding, by the processor, the laser to perform the first scan of the dairy livestock again.

11. The method of claim 10 , wherein the predetermined amount is less than or equal to 5 mm.

12. The method of claim 8 , further comprising:
determining, by the processor, that the first teat is not found in the second profile signal; and
in response to determining that the first teat is not found in the second profile signal, commanding, by the processor, the robotic arm to move back to the first location corresponding to the expected teat position.

13. The method of claim 8 , wherein the laser is coupled to the robotic arm.

14. The method of claim 8 , wherein the dairy livestock is in a stall.

15. One or more computer-readable non-transitory storage media comprising software that is executable by one or more processors to:
access a first profile signal generated by a laser from a first scan of a dairy livestock;
determine that a first teat of the dairy livestock is found in the first profile signal, the first teat located at a first scan location within the first profile signal;
in response to determining that the first teat is found in the first profile signal, command a robotic arm to move to a first location corresponding to the first scan location;
increment a counter corresponding to the first teat;
determine whether the counter equals a predetermined number;
in response to determining that the counter equals the predetermined number, command the robotic arm to attach a teat cup to the first teat; and
in response to determining that the counter does not equal the predetermined number:
access a second profile signal generated by the laser from a second scan;
determine that the first teat is found in the second profile signal; and
in response to determining that the first teat is found in the second profile signal, command the robotic arm to attach the teat cup to the first teat.

16. The one or more computer-readable non-transitory storage media of claim 15 , wherein the predetermined number is three.

17. The one or more computer-readable non-transitory storage media of claim 15 , the software further executable by the one or more processors to:
determine that the first teat is not found in the first profile signal;
in response to determining that the first teat is not found in the first profile signal, command the robotic arm to move up a predetermined amount; and
after the robotic arm moves up the predetermined amount, command the laser to perform the first scan of the dairy livestock again.

18. The one or more computer-readable non-transitory storage media of claim 17 , wherein the predetermined amount is less than or equal to 5 mm.

19. The one or more computer-readable non-transitory storage media of claim 15 , the software further executable by the one or more processors to:
determine that the first teat is not found in the second profile signal; and
in response to determining that the first teat is not found in the second profile signal, command the robotic arm to move back to the first location corresp

Assignees

• Technologies Holdings Corp

Inventors

• Foresman Mark A
• Van Anart Marijn
• Van Der Sluis Peter Willem

Classifications

• B25J19/022

  using lasers · CPC title

• A01K1/12

  Milking stations · CPC title

• A01J5/0175 Primary

  Attaching of clusters · CPC title

• B25J9/1697

  Vision controlled systems · CPC title

• A01J5/007

  Monitoring milking processes; Control or regulation of milking machines · CPC title