Gathering data from machine operating at worksite

Patent metadata

Field	Value
Publication number	US-9786105-B2
Application number	US-201514962097-A
Country	US
Kind code	B2
Filing date	Dec 8, 2015
Priority date	Dec 8, 2015
Publication date	Oct 10, 2017
Grant date	Oct 10, 2017

Abstract

A data gathering system associated with a machine operating at a worksite is provided. The data gathering system includes a base station located at the worksite and an unmanned aerial device (UAD) in communication with the base station and the machine. The UAD includes an image capturing unit for capturing images of an area around the machine and a controller in communication with the image capturing unit. The controller receives a first input from the machine indicative of one or more machine parameters, and receives a second input from the image capturing unit indicative of the images of the area around the machine. The controller further determines multiple operational parameters associated with an operation of the machine based on the first input and the second input, and transmits the determined multiple operational parameters to at least one of the machine and the base station.

First claim

What is claimed is:

1. A data handling system associated with a working machine operating at a worksite, the data gathering system comprising:
a base station located at the worksite; and
an unmanned aerial device communicatively coupled to the working machine using a cable, and configured to communicate with the base station, wherein the cable is configured to receive electric power from the working machine to propel the unmanned aerial device, the unmanned aerial device comprising:
an image capturing unit configured to capture one or more image of an area around and including the working machine; and
a controller in communication with the image capturing unit, the controller configured to:
receive a first input from the working machine via the cable, the first input indicative of one or more machine parameters;
receive a second input from the image capturing unit, the second input indicative of the one or more images of the area around and including the working machine;
determine multiple operational parameters associated with an operation of the working machine based on the first input and the second input; and
transmit the determined multiple operational parameters to at least one of the working machine and the base station,

wherein the unmanned aerial device is configured to be disposed at a height relative to the working machine so the image capturing unit captures one or more images of operation of the working machine corresponding to the one or more machine parameters associated with the first input,
wherein the one or more machine parameters received from the working machine by the controller identify to the controller the one or more machine parameters of the working machine to capture and analyze using the image capturing unit of the unmanned aerial device,
wherein the multiple operational parameters comprise at least one of a position of an implement of the working machine relative to a frame thereof, data regarding loading of the working machine, data regarding proximity of the working machine to a truck in the area around and including the working machine, a bucket fill factor associated with the implement of the working machine, and a bucket loading and unloading work cycle of the working machine, and
wherein the determined multiple operational parameters are transmitted to the working machine via the cable and include instructions to be provided, via the working machine, to an operator of the working machine to operate the working machine to reach a predetermined value of at least one of the determined multiple operational parameters.

2. The data handling system of claim 1 ,
wherein the controller is configured to communicate with a first processing unit disposed in the working machine, and
wherein the first processing unit is in communication with a sensing unit of the working machine, the sensing unit configured to generate a signal indicative of the one or more machine parameters.

3. The data handling system of claim 2 , wherein the cable is configured to communicate with the controller of the unmanned aerial device and the first processing unit of the working machine.

4. The data handling system of claim 3 ,
wherein the controller is configured to transmit the first input and the second input to the first processing unit via the cable, and
wherein the first processing unit is configured to determine the multiple operational parameters associated with the working machine based on the first input and the second input.

5. The data handling system of claim 1 , wherein the controller is configured to communicate with a second processing unit disposed in the base station, and transmit the first input and the second input to the second processing unit, the controller configured to:
receive a third input from the base station, the third input indicative of the multiple operational parameters associated with an operation of the working machine, wherein the third input is determined by the second processing unit; and
transmit the third input to the working machine.

6. The data handling system of claim 1 , wherein the controller is configured to determine presence of the truck and a work aggregate within the area around and including the working machine, based on the second input received from the image capturing unit.

7. The data handling system of claim 1 , wherein the unmanned aerial device comprises at least one of a camera, a light detection and ranging (LIDAR) unit, a forward looking infrared (FLIR) unit, a magnetometer, a global positioning system (GPS), and an inertial measurement unit (IMU).

8. A method for handling data associated with an operation of a working machine at a worksite, the method comprising:
receiving, by a controller of an unmanned aerial device, from the working machine via a cable, a first input indicative of one or more machine parameters, wherein the unmanned aerial device is communicatively coupled to the working machine via the cable;
disposing the unmanned aerial device at a height relative to the working machine so an image capturing unit of the unmanned aerial device captures one or more images of operation of the working machine corresponding to the one or more machine parameters associated with the first input;
receiving, from the image capturing unit of the unmanned aerial device, a second input indicative of one or more images of an area around and including the working machine;
determining, by the controller, multiple operational parameters associated with the operation of the working machine based on the first input and the second input;
transmitting, by the controller, the determined multiple operational parameters to the working machine via the cable and to a base station, wherein the base station is in communication with the unmanned aerial device, the determined multiple operational parameters transmitted to the working machine via the cable including instructions to be provided, via the working machine, to an operator of the working machine to operate the machine to reach a predetermined value of each of the determined multiple operational parameters;
electronically outputting, at the working machine, the instructions to the operator of the working machine to operate the working machine to reach the predetermined value of each of the determined multiple operational parameters;
controlling the working machine based on the transmitted multiple operational parameters;
determining, by the controller, presence of a truck within the area around and including the working machine based on the second input;
electronically receiving, by the working machine from the base station, information regarding the presence of the truck within the area around and including the working machine; and
electronically outputting, by the working machine, the information regarding the presence of the truck within the area around and including the working machine,
wherein the one or more machine parameters received from the working machine by the controller identify to the controller the one or more machine parameters of the working machine to capture and analyze using the image capturing unit of the unmanned aerial device, and
wherein the multiple operational parameters comprise at least one of a position of an implement of the working machine relative to a frame thereof, data regarding loading of the working machine, data regarding proximity of the working machine to the truck in the area around and including the working machine, a bucket fill factor associated with the implement of the working machine, and a bucket loading and unloading work cycle of the working machine.

9. The method of claim 8 further comprising generating, by the controller, a signal indicative of the one or

Assignees

• Caterpillar Inc

Inventors

• Moloney Neil J
• Natale Nicholas A

Classifications

• B64U2101/30

  for imaging, photography or videography · CPC title

• B64U2201/202

  using tethers for connecting to ground station · CPC title

• B64D47/08

  Arrangements of cameras · CPC title

• B64C39/022

  Tethered aircraft · CPC title

• G07C5/0841 Primary

  Registering performance data (recording measured values G01D; information storage G11B) · CPC title