Detection of moving objects

Patent metadata

Field	Value
Publication number	US-11928874-B2
Application number	US-202117320803-A
Country	US
Kind code	B2
Filing date	May 14, 2021
Priority date	May 15, 2020
Publication date	Mar 12, 2024
Grant date	Mar 12, 2024

Abstract

A camera (10) for detecting objects (48) moving relative to the camera (10) in a direction of movement (50), comprising an image sensor (18) for recording image data of the objects (48) in a camera field of view (14, 56), an optoelectronic distance sensor (24) using a time-of-flight method having a plurality of measurement zones (30a) for measuring a plurality of distance values to the objects (48) in a distance measurement field of view (58), and a control and evaluation unit (38) configured to find, by measuring distance values over a configuration time and evaluating the distance values and/or their change, a region where objects (48) move, and to automatically set a region of interest (60) for the distance sensor (24) within the distance measurement field of view (58) by determining an object region as the region where objects (48) move.

First claim

The invention claimed is:

1. A method for detecting objects ( 48 ) moving in a direction of movement ( 50 ), the method comprising:
using an image sensor ( 18 ) for recording image data of the objects ( 48 ) in a camera field of view ( 14 , 56 );
using an optoelectronic distance sensor ( 24 ) according to a principle of a time-of-flight method having a plurality of measurement zones ( 30 a ) for measuring a plurality of distance values to the objects ( 48 ) in a distance measurement field of view ( 58 );
using signals from the image sensor ( 18 ) and the distance sensor ( 24 ) to measure distance values over a configuration time and to evaluate at least one of the distance values and a change of the distance values, a region where objects ( 48 ) move, and to automatically set a region of interest ( 60 ) for the distance sensor ( 24 ) within the distance measurement field of view ( 58 ) by determining an object region as the region where objects ( 48 ) move;
determining a statistical measure for changes in the distance values of a respective measurement zone ( 30 a ) over a variation time; and
determining a respective maximum value of the distance values of a respective measurement zone ( 30 a ) over a background detection time.

2. The method according to claim 1 , further comprising adjusting the region of interest ( 60 ) based on the maximum values and an expected background geometry.

3. The method according to claim 2 , wherein the adjustment concerns a direction transverse to the direction of movement ( 50 ).

4. The method according to claim 1 , further comprising restricting the region of interest ( 60 ) along the direction of movement ( 50 ) to an entrance region directed towards the moving objects ( 48 ).

5. A method for detecting objects ( 48 ) moving in a direction of movement ( 50 ), the method comprising:
using an image sensor ( 18 ) for recording image data of the objects ( 48 ) in a camera field of view ( 14 , 56 );
using an optoelectronic distance sensor ( 24 ) according to a principle of a time-of-flight method having a plurality of measurement zones ( 30 a ) for measuring a plurality of distance values to the objects ( 48 ) in a distance measurement field of view ( 58 );
using signals from the image sensor ( 18 ) and the distance sensor ( 24 ) to measure distance values over a configuration time and to evaluate at least one of the distance values and a change of the distance values, a region where objects ( 48 ) move, and to automatically set a region of interest ( 60 ) for the distance sensor ( 24 ) within the distance measurement field of view ( 58 ) by determining an object region as the region where objects ( 48 ) move; and
determining a respective maximum value of the distance values of a respective measurement zone ( 30 a ) over a background detection time.

6. The method according to claim 1 ,
wherein the distance measurement field of view ( 58 ) projects beyond the camera field of view ( 56 ).

7. The method according to claim 6 ,
wherein the distance measurement field of view ( 58 ) projects beyond the camera field of view ( 56 ) against the direction of movement ( 50 ).

8. The method according to claim 1 , further comprising reading out code contents of codes ( 52 ) in the recorded image data of the objects ( 48 ).

9. The method according to claim 1 ,
which is stationarily mounted on a conveyor device ( 46 ) which conveys the objects ( 48 ) in the direction of movement ( 50 ).

10. A method for detecting objects ( 48 ) moving in a direction of movement ( 50 ), the method comprising:
using an image sensor ( 18 ) for recording image data of the objects ( 48 ) in a camera field of view ( 14 , 56 );
using an optoelectronic distance sensor ( 24 ) according to a principle of a time-of-flight method having a plurality of measurement zones ( 30 a ) for measuring a plurality of distance values to the objects ( 48 ) in a distance measurement field of view ( 58 ),
wherein the distance sensor ( 24 ) comprises a plurality of avalanche photodiodes ( 30 a ) operable in Geiger mode;
using signals from the image sensor ( 18 ) and the distance sensor ( 24 ) to measure distance values over a configuration time and to evaluate at least one of the distance values and a change of the distance values, a region where objects ( 48 ) move, and to automatically set a region of interest ( 60 ) for the distance sensor ( 24 ) within the distance measurement field of view ( 58 ) by determining an object region as the region where objects ( 48 ) move,
wherein the distance sensor ( 24 ) comprises a plurality of avalanche photodiodes ( 30 a ) operable in Geiger mode,
and wherein the region of interest ( 60 ) is adjusted by selectively activating the Geiger mode in avalanche photodiodes ( 30 a ) corresponding to the region of interest ( 60 ); and
adjusting the region of interest ( 60 ) by selectively activating the Geiger mode in avalanche photodiodes ( 30 a ) corresponding to the region of interest ( 60 ).

11. The method according to claim 10 ,
further comprising determining a statistical measure for changes in the distance values of a respective measurement zone ( 30 a ) over a variation time.

12. The method according to claim 10 ,
further comprising determining a respective maximum value of the distance values of a respective measurement zone ( 30 a ) over a background detection time.

13. The method according to claim 5 ,
wherein the optoelectronic distance sensor ( 24 ) comprises a plurality of avalanche photodiodes ( 30 a ) operable in Geiger mode,
and further comprising adjusting the region of interest ( 60 ) by selectively activating the Geiger mode in avalanche photodiodes ( 30 a ) corresponding to the region of interest ( 60 ).

Assignees

• Sick Ag

Inventors

• Müller Romain
• Strohmeier Dirk

Classifications

• G06V20/64 Primary

  Three-dimensional [3D] objects · CPC title

• G01C3/08

  Use of electric radiation detectors · CPC title

• G06K7/1413

  1D bar codes · CPC title

• G06K7/1417

  2D bar codes · CPC title

• G06V10/147

  Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19) · CPC title