Systems and methods for image capture device calibration for a materials handling vehicle

Patent metadata

Field	Value
Publication number	US-2016353099-A1
Application number	US-201615158893-A
Country	US
Kind code	A1
Filing date	May 19, 2016
Priority date	May 26, 2015
Publication date	Dec 1, 2016
Grant date	—

Abstract

Systems and methods for calibrating an image capture device for a materials handling vehicle. One embodiment of a system includes the image capture device and a vehicle computing device, where the vehicle computing device stores logic that when executed by a processor, causes the materials handling vehicle to determine a current location of the materials handling vehicle in a warehouse and determine a seed value associated with the image capture device, the seed value representing initial calibration parameters of the image capture device. In some embodiments, the logic causes the materials handling vehicle to capture image data in the warehouse, compare the image data with a site map, and determine a calibrated value for the image capture device from the comparison and the seed value.

First claim

What is claimed is:

1 . A system for calibrating an image capture device for a materials handling vehicle comprising the image capture device and a vehicle computing device, wherein:
the vehicle computing device stores logic that when executed by a processor, causes the materials handling vehicle to perform at least the following:
determine a current location of the materials handling vehicle in a warehouse;
determine a seed value associated with the image capture device, the seed value representing initial calibration parameters of the image capture device;
capture image data in the warehouse, the image data including a location identifier that is representative of a location in the warehouse;
compare the image data with a site map, the site map representing imagery and location data of a ceiling in the warehouse;
determine a calibrated value for the image capture device from the comparison and the seed value; and
apply the calibrated value for determining a new location of the materials handling vehicle.

2 . The system of claim 1 , wherein the logic further causes the system to perform at least the following:
compute a calibration confidence related to accuracy of the calibrated value for the image capture device, the calibration confidence being representative an accuracy of the calibrated value based on a comparison of the image data with the site map; determine whether the calibration confidence meets a predetermined threshold; provide a visual indication of the calibration confidence to a user; and in response to determining that the calibration confidence does not meet the predetermined threshold, provide an instruction to restart calibration.

3 . The system of claim 2 , wherein the logic further causes the system to report the calibration confidence to the user.

4 . The system of claim 1 , wherein the seed value includes data related to at least one of the following: pitch of the image capture device, roll of the image capture device, and yaw of the image capture device.

5 . The system of claim 1 , wherein the current location of the materials handling vehicle is received from at least one of the following: a user input and triggering of a sensor.

6 . The system of claim 1 , further comprising a remote computing device, wherein the logic further causes the vehicle computing device to communicate with the remote computing device to construct an optimization problem.

7 . The system of claim 6 , wherein the remote computing device utilizes a smoothing and mapping (SAM) library for constructing the optimization problem.

8 . The system of claim 7 , wherein the remote computing device utilizes simultaneous localization and mapping (SLAM) to construct the optimization problem.

9 . The system of claim 7 , wherein logic further causes the vehicle computing device to communicate at least one of the following to the remote computing device: the image data, data related to the site map, and data related to the image capture device.

10 . The system of claim 7 , wherein determining the calibrated value for the image capture device from the comparison includes receiving data from the remote computing device.

11 . The system of claim 1 , wherein the logic causes the materials handling vehicle to traverse a predetermined route to reach a destination.

12 . The system of claim 1 , wherein comparing the image data with the site map comprises identifying a segment of the site map that applies to the image data.

13 . The system of claim 1 , wherein the image data includes an image of a light fixture.

14 . A materials handling vehicle comprising an image capture device and a vehicle computing device, wherein:
the vehicle computing device stores logic that when executed by a processor, causes the materials handling vehicle to perform at least the following:
determine a current location of the materials handling vehicle;
determine a seed value associated with the image capture device, the seed value representing initial calibration parameters of the image capture device;
capture image data in a warehouse, the image data including a location identifier that is representative of a location in the warehouse;
communicate with a remote computing device to compare the image data with a site map and create an optimization problem, the optimization problem being created via a communication with a mapping library, the site map representing imagery and location data of a ceiling in the warehouse;
determine a calibrated value for the image capture device from an output of the optimization problem; and
apply the calibrated value for determining a new location of the materials handling vehicle.

15 . The materials handling vehicle of claim 14 , wherein the logic further causes the materials handling vehicle to perform at least the following:
compute a calibration confidence related to accuracy of the calibrated value for the image capture device, wherein the calibration confidence is representative an accuracy of the calibrated value based on a comparison of the image data with the site map; determine whether the calibration confidence meets a predetermined threshold; and in response to determining that the calibration confidence does not meet the predetermined threshold, provide an instruction to restart calibration.

16 . The materials handling vehicle of claim 14 , wherein the seed value includes data related to at least one of the following: pitch of the image capture device, roll of the image capture device, and yaw of the image capture device.

17 . The materials handling vehicle of claim 14 , wherein the remote computing device utilizes a smoothing and mapping (SAM) library for constructing the optimization problem.

18 . The materials handling vehicle of claim 14 , wherein logic further causes the vehicle computing device to communicate at least one of the following to the remote computing device: the image data, data related to the site map, and data related to the image capture device.

19 . A method for calibrating an image capture device for a materials handling vehicle comprising:
determining a current location of the materials handling vehicle; estimating a seed value associated with the image capture device, wherein the seed value includes data related to at least one of the following: pitch of the image capture device, roll of the image capture device, and yaw of the image capture device; capturing image data in an environment, wherein the image data includes a location identifier that is representative of a location in a warehouse; communicating with a remote computing device to compare the image data with a site map to create an optimization problem, wherein the remote computing device utilizes a smoothing and mapping (SAM) library for creating the optimization problem; determining a calibrated value for the image capture device from the comparison and the seed value; computing a calibration confidence related to accuracy of the calibrated value for the image capture device, wherein the calibration confidence is representative an accuracy of the calibrated value based on a comparison of the image data with the site map; determining whether the calibration confidence meets a predetermined threshold; in response to determining that the calibration confidence does not meet the predetermined threshold, providing an instruction to restart calibration; and in response to determining that the calibration confidence does meet the predetermined threshold, applying the calibrated value for d

Assignees

• Crown Equip Corp

Inventors

• Thomson Jacob Jay
• Fanselow Timothy William

Classifications

• G06T7/74 Primary

  involving reference images or patches · CPC title

• H04N17/002 Primary

  for television cameras · CPC title

• G06T2207/30252

  Vehicle exterior; Vicinity of vehicle · CPC title

• G06T2207/30244

  Camera pose · CPC title

• G01C21/206

  specially adapted for indoor navigation · CPC title