Shovel and shovel assist system

Patent metadata

Field	Value
Publication number	US-2021246631-A1
Application number	US-202117241261-A
Country	US
Kind code	A1
Filing date	Apr 27, 2021
Priority date	Oct 31, 2018
Publication date	Aug 12, 2021
Grant date	—

Abstract

A shovel includes a processor, and a memory storing program instructions that cause the processor to obtain environmental information around the shovel, and perform determination related to an object around the shovel based on the obtained environmental information, by using a learned model on which machine learning has been performed. The learned model is updated to an additionally learned model on which additional learning has been performed based on teaching information generated from the obtained environmental information. In a case where the learned model is updated, the processor performs the determination based on the obtained environmental information, by using the updated learned model.

First claim

What is claimed is:

1 . A shovel comprising:
a processor; and a memory storing program instructions that cause the processor to: obtain environmental information around the shovel; and perform determination related to an object around the shovel based on the obtained environmental information, by using a learned model on which machine learning has been performed; wherein the learned model is updated to an additionally learned model on which additional learning has been performed based on teaching information generated from the obtained environmental information; and wherein, in a case where the learned model is updated, the processor performs the determination based on the obtained environmental information, by using the updated learned model.

2 . The shovel as claimed in claim 1 , wherein the learned model is updated to the additionally learned model on which the additional learning has been performed based on the teaching information generated from the environmental information obtained by at least one of the shovel or another shovel different from the shovel.

3 . The shovel as claimed in claim 1 ,
wherein a plurality of shovels including the shovel include the identical learned model and perform the determination by using the learned model, and wherein the learned model included in each of the plurality of shovels is updated to the additionally learned model.

4 . The shovel as claimed in claim 1 , wherein the learned model is updated to the additionally learned model on which the additional learning has been performed based on the teaching information generated from the environmental information around a plurality of said shovels, the environmental information being obtained at the plurality of shovels.

5 . The shovel as claimed in claim 1 ,
wherein the instructions cause the processor to further record the environmental information obtained at a predetermined timing, and wherein the learned model is updated to the additionally learned model on which the additional learning has been performed based on the teaching information generated from the recorded environmental information.

6 . The shovel as claimed in claim 5 , wherein the predetermined timing is when the shovel turns or the shovel travels.

7 . The shovel as claimed in claim 5 ,
wherein the processor performs the determination related to detection of the object around the shovel, and wherein the predetermined timing is when the processor determines that the object around the shovel is detected.

8 . The shovel as claimed in claim 1 , further comprising:
an actuator; and a controller configured to control the actuator based on the determination.

9 . The shovel as claimed in claim 1 , further comprising:
an operating device; and an actuator that is driven based on an operation performed on the operating device, wherein, in a case where it is determined that the object is present within a predetermined range around the shovel based on the determination, the actuator is not driven even if the operating device is operated.

10 . A shovel assist system, comprising:
a first shovel; a second shovel; and an external device configured to communicate with the first shovel and the second shovel, wherein the first shovel includes a processor; and a memory storing program instructions that cause the processor to:
obtain environmental information around the first shovel; and
perform determination related to an object around the first shovel based on the obtained environmental information around the first shovel, by using a learned model on which machine learning has been performed;
wherein the second shovel includes a processor; and a memory storing program instructions that cause the processor to:
obtain environmental information around the second shovel;
record the obtained environmental information around the second shovel; and
transmit the recorded environmental information to the external device; and
wherein the external device includes a processor; and a memory storing program instructions that cause the processor to:
generate teaching information based on the environmental information around the second shovel, received from the second shovel;
perform additional learning on a learned model identical to the learned model used to perform the determination at the first shovel, based on the generated teaching information, to generate an additionally learned model; and
transmit, to the first shovel, the additionally learned model on which the additional learning has been performed,
wherein the learned model is updated to the additionally learned model received from the external device at the first shovel, and wherein the determination is performed, in a case where the learned model is updated, by using the updated learned model, based on the obtained environmental information around the first shovel.

11 . The shovel assist system claimed in claim 10 , wherein the first shovel is the second shovel.

12 . The shovel assist system claimed in claim 10 , comprising a plurality of said first shovels, wherein the external device communicates with the plurality of first shovels.

13 . The shovel assist system claimed in claim 10 , comprising a plurality of said second shovels, wherein the external device communicates with the plurality of second shovels.

14 . The shovel claimed in claim 1 , wherein the processor performs the determination related to a motion content of the object by using the learned model based on the environmental information obtained sequentially in time.

15 . The shovel assist system claimed in claim 10 , wherein the processor performs the determination related to a motion content of the object by using the learned model based on the environmental information obtained sequentially in time.

16 . A machine learning device comprising:
a processor; and a memory storing program instructions that cause the processor perform machine learning on a learning model to generate a learned model based on a data set, the data set being a combination of environmental information in a work site where a shovel is disposed and a correct answer to be output by the learning model in response to the environmental information being input to the learning model.

17 . The machine learning device claimed in claim 16 , wherein the program instructions further cause the processor to update the learned model to an additionally learned model on which additional learning has been performed based on teaching information generated from surrounding environmental information obtained by a plurality of shovels.

Assignees

• Sumitomo Construction Machinery Co Ltd

Inventors

• Kurosawa Ryota

Classifications

• G06N3/045

  Combinations of networks · CPC title

• G06N5/01

  Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06N3/09

  Supervised learning · CPC title

• G06N3/084

  Backpropagation, e.g. using gradient descent · CPC title