State monitoring method and state monitoring system

Patent metadata

Field	Value
Publication number	US-12244785-B2
Application number	US-202318218261-A
Country	US
Kind code	B2
Filing date	Jul 5, 2023
Priority date	Jul 12, 2022
Publication date	Mar 4, 2025
Grant date	Mar 4, 2025

Abstract

The state monitoring system includes: a 3D camera configured to acquire an image in a work area; and information processing apparatus connected to the 3D camera and including a processing unit and a storage unit. The processing unit calculates a camera setting parameter that determines an imaging condition of the 3D camera with respect to a monitoring target as a target to be monitored in the work area and stores the camera setting parameter in the storage unit, determines the imaging condition of the 3D camera by applying the camera setting parameter corresponding to the monitoring target with reference to the camera setting parameter stored in the storage unit, acquires an image of the monitoring target from the 3D camera configured to image the monitoring target in the determined imaging condition, and determines a state of the monitoring target based on the acquired image of the monitoring target.

First claim

What is claimed is:

1. A state monitoring method using a 3D camera configured to acquire an image in a work area and information processing apparatus connected to the 3D camera and including a processing unit and a storage unit, the method comprising:
allowing the processing unit to
calculate a camera setting parameter that determines an imaging condition of the 3D camera with respect to a monitoring target as a target to be monitored in the work area and store the camera setting parameter in the storage unit,
determine the imaging condition of the 3D camera by applying the camera setting parameter corresponding to the monitoring target with reference to the camera setting parameter stored in the storage unit,
acquire an image of the monitoring target from the 3D camera configured to image the monitoring target in the determined imaging condition, and
determine a state of the monitoring target based on the acquired image of the monitoring target.

2. The state monitoring method according to claim 1 , further comprising:
allowing the processing unit to
acquire position coordinates of the monitoring target from the image acquired by the 3D camera, and
calculate the camera setting parameter based on the acquired position coordinates.

3. The state monitoring method according to claim 1 , further comprising:
allowing the storage unit to
store position management information that is information regarding position coordinates of the monitoring target; and
allowing the processing unit to
acquire the position coordinates of the monitoring target using the position management information and
calculate the camera setting parameter based on the acquired position coordinates.

4. The state monitoring method according to claim 1 , further comprising allowing the processing unit to calculate a camera setting parameter that determines an orientation of the 3D camera with respect to the monitoring target.

5. The state monitoring method according to claim 1 , further comprising allowing the processing unit to calculate a camera setting parameter that adjusts an viewing angle of the 3D camera with respect to the monitoring target.

6. The state monitoring method according to claim 1 , further comprising allowing the processing unit to calculate a camera setting parameter that executes pixel interpolation on the image acquired by the 3D camera when the monitoring target is acquired.

7. The state monitoring method according to claim 1 , further comprising:
allowing the processing unit to
generate a plurality of two-dimensional images of the monitoring target from different viewpoints based on the image of the monitoring target acquired from the 3D camera,
to classify the generated two-dimensional images depending on a configuration belonging to the monitoring target, and
to determine a state of the configuration belonging to the monitoring target.

8. A state monitoring system comprising:
a 3D camera configured to acquire an image in a work area; and
information processing apparatus connected to the 3D camera, wherein
the information processing apparatus includes a processing unit and a storage unit, and
the processing unit
calculates a camera setting parameter that determines an imaging condition of the 3D camera with respect to a monitoring target as a target to be monitored in the work area and stores the camera setting parameter in the storage unit,
determines the imaging condition of the 3D camera by applying the camera setting parameter corresponding to the monitoring target with reference to the camera setting parameter stored in the storage unit,
acquires an image of the monitoring target from the 3D camera configured to image the monitoring target in the determined imaging condition, and
determines a state of the monitoring target based on the acquired image of the monitoring target.

9. The state monitoring system according to claim 8 , wherein
the processing unit
acquires position coordinates of the monitoring target from the image acquired by the 3D camera, and
calculates the camera setting parameter based on the acquired position coordinates.

10. The state monitoring system according to claim 8 , wherein
the storage unit
stores position management information that is information regarding position coordinates of the monitoring target, and
the processing unit
acquires the position coordinates of the monitoring target using the position management information, and
calculates the camera setting parameter based on the acquired position coordinates.

11. The state monitoring system according to claim 8 , wherein the processing unit calculates a camera setting parameter that determines an orientation of the 3D camera with respect to the monitoring target.

12. The state monitoring system according to claim 8 , wherein the processing unit calculates a camera setting parameter that adjusts an viewing angle of the 3D camera with respect to the monitoring target.

13. The state monitoring system according to claim 8 , wherein the processing unit calculates a camera setting parameter that executes pixel interpolation on the image acquired by the 3D camera when the monitoring target is acquired.

14. The state monitoring system according to claim 8 , wherein
the processing unit
generates a plurality of two-dimensional images of the monitoring target from different viewpoints based on the image of the monitoring target acquired from the 3D camera,
classifies the generated two-dimensional images depending on a configuration belonging to the monitoring target, and
determines a state of the configuration belonging to the monitoring target.

15. The state monitoring system according to claim 8 , further comprising an information terminal configured to output information regarding the state of the monitoring target determined by the information processing apparatus, the information terminal being carried by a worker in the work area.

Assignees

• Hitachi Ltd

Inventors

• Serizawa Yasutaka
• Matsumoto Hisanori
• Ono Goichi

Classifications

• G06T7/85

  Stereo camera calibration · CPC title

• G06T2207/30232

  Surveillance · CPC title

• G06T2207/30244

  Camera pose · CPC title

• G06V20/52 Primary

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• H04N13/282

  for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems · CPC title