Information processing system and information processing method

Patent metadata

Field	Value
Publication number	US-2024328124-A1
Application number	US-202418743623-A
Country	US
Kind code	A1
Filing date	Jun 14, 2024
Priority date	Dec 22, 2021
Publication date	Oct 3, 2024
Grant date	—

Abstract

An information processing system includes a shovel including an imaging device; an information processing device; and circuitry configured to cause the shovel to transmit data to the information processing device, the data including an image captured by the imaging device and at least one of a direction, a time, or a position in association with the image, and to cause the information processing device to perform, in response to designation of at least one of the direction, the time, or the position, control for displaying the image in association with at least a designated one of the direction, the time, or the position.

First claim

What is claimed is:

1 . An information processing system comprising:
a shovel including an imaging device; an information processing device; and circuitry configured to
cause the shovel to transmit data to the information processing device, the data including an image captured by the imaging device and at least one of a direction, a time, or a position in association with the image, and
cause the information processing device to perform, in response to designation of at least one of the direction, the time, or the position, control for displaying the image in association with at least a designated one of the direction, the time, or the position.

2 . The information processing system according to claim 1 , wherein the shovel includes a plurality of the imaging devices oriented in different imaging directions, and
wherein the circuitry is configured to cause the shovel to transmit the data to the information processing device, the data including an image captured by each of the plurality of imaging devices.

3 . The information processing system according to claim 1 , wherein the circuitry causes the information processing device to perform control for displaying a screen, using the image in association with the designated position, the screen representing surroundings with the designated position as a viewpoint.

4 . The information processing system according to claim 1 , wherein the circuitry causes the information processing device to perform control for displaying a screen using the image captured at the designated time.

5 . The information processing system according to claim 1 , wherein upon the designation of the direction being received after the control for displaying a first screen using the image, the circuitry causes the information processing device to perform control for displaying a second screen, the second screen representing the designated direction from the position at which the image is captured.

6 . The information processing system according to claim 1 , wherein the circuitry causes the information processing device to store the data in a storage unit for each of work sites in which the shovel has performed work, the data being received from the shovel, and
wherein upon a desired work site being designated, the circuitry causes the information processing device to perform control for displaying the image captured at the designated work site.

7 . The information processing system according to claim 1 , wherein the circuitry causes the information processing device to combine images differing in at least one of the direction, the time, or the position included in the received data to perform control for displaying a combined image.

8 . The information processing system according to claim 7 , wherein the circuitry causes the information processing device to combine a plurality of the images captured by the shovel at a same position, at a same time, and in different directions at a time of capturing the images to generate an overhead view, and to perform control for displaying the overhead view, the overhead view representing surroundings of the shovel.

9 . The information processing system according to claim 7 , wherein the circuitry causes the information processing device to combine a plurality of images captured by the shovel at a same position, at different times, and in different directions to generate an overhead view, and to perform control for displaying the overhead view, the overhead view representing surroundings of the shovel.

10 . The information processing system according to claim 7 , wherein the circuitry causes the information processing device to combine a plurality of the images captured by the shovel at a same position and in different directions, based on the data received from the shovel working in a work site to generate a first overhead view for each of positions included in the work site, and to subsequently generate a second overhead view, based on the generated first overhead views, the second overhead view representing the work site in an overhead view manner.

11 . The information processing system according to claim 1 , wherein the circuitry causes the information processing device to perform control for displaying display information indicating a position of a work site on map data, and
wherein upon the display information being designated, the circuitry causes the information processing device to perform control for displaying the image captured by the shovel existing in the work site, the work site being indicated by the display information.

12 . The information processing system according to claim 1 , wherein the circuitry causes the information processing device to perform control for displaying display information indicating a position captured by the shovel on map data, the map data representing a work site, and
wherein upon the display information being designated, the circuitry causes the information processing device to perform control for displaying the image captured by the shovel at the position indicated by the display information.

13 . The information processing system according to claim 1 , wherein the circuitry causes the information processing device to perform control for displaying operation information capable of setting a time span, together with displaying a first image, and
wherein upon a time span being designated by the operation information, the circuitry causes the information processing device to perform control for displaying a second image, the second image being captured from a same position at which the first image is captured and being captured in the designated time span.

14 . The information processing system according to claim 1 , wherein the circuitry causes the shovel to capture an image by the imaging device every time the shovel moves by a predetermined distance or every time a predetermined time has elapsed.

15 . The information processing system according to claim 1 , wherein the circuitry causes the information processing device to further perform control for displaying display information on a screen represented based on the image, the display information representing a position at which the shovel has performed imaging, and
wherein upon the display information being designated, the circuitry causes the information processing device to perform control for displaying the screen represented based on the image, the image being captured at the position indicated by the display information.

16 . The information processing system according to claim 15 , wherein the display information displayed on the screen is displayed in a different display mode according to the shovel that has performed imaging from the position indicated by the display information.

17 . A non-transitory computer-readable storage medium storing a program for causing a computer to execute a process, the process comprising:
receiving designation of at least one of a direction, a time, or a position at which an image is captured by an imaging device, the imaging device being provided in a shovel; and displaying the image in association with at least a designated one of the direction, the time, or the position.

18 . An information processing method executed by an information processing system, the information processing system including a shovel and an information processing device, the shovel having an imaging device, the information processing method comprising:
causing the shovel to transmit data to the information processing device, the data including an image ca

Assignees

• Sumitomo Construction Machinery Co Ltd

Inventors

• Izumikawa Takeya
• Umeda Takashi

Classifications

• E02F9/205

  Remotely operated machines, e.g. unmanned vehicles (E02F3/8866 takes precedence) · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• E02F9/261 Primary

  Surveying the work-site to be treated · CPC title

• H04N7/18

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title

• E02F9/26 Primary

  Indicating devices {(E02F5/145 takes precedence)} · CPC title