Monitoring system of a passenger conveyor, a passenger conveyor, and a monitoring method thereof

Patent metadata

Field	Value
Publication number	US-10479653-B2
Application number	US-201715663456-A
Country	US
Kind code	B2
Filing date	Jul 28, 2017
Priority date	Jul 29, 2016
Publication date	Nov 19, 2019
Grant date	Nov 19, 2019

Abstract

A monitoring system includes: an imaging sensor configured to sense a lighting device of the passenger conveyor to acquire image data; and a processing apparatus configured to process the image data, the processing apparatus being configured to include: a background acquisition module configured to acquire a background model based on sensed image data; a foreground detection module configured to compare image data sensed in real time with the background model to obtain a foreground object; and a working condition judgment module configured to perform data processing at least based on the foreground object to judge whether the lighting device is in a normal state. Then, a failure or an abnormal lighting state of the lighting device can be timely diagnosed so that maintenance is performed.

First claim

The invention claimed is:

1. A monitoring system of, comprising:
an imaging sensor configured to sense a lighting device of the passenger conveyor to acquire image data;
a microcontroller configured to process the image data to monitor whether the lighting device is in a normal state, the microcontroller having a plurality of modules, wherein the plurality of modules includes:
a background acquisition module configured to acquire a background model based on the image data sensed when the lighting device is in a normal state or in an abnormal state;
a foreground detection module configured to compare image data sensed in real time with the background model to obtain a foreground object; and
a working condition judgment module configured to perform data processing at least based on the foreground object to judge whether the lighting device is in a normal state.

2. The monitoring system of claim 1 , wherein the microcontroller further comprises:
a foreground feature extraction module configured to extract a corresponding lighting state foreground feature from the foreground object;
wherein the working condition judgment module judges, based on the lighting state foreground feature, whether the lighting device is in a normal state.

3. The monitoring system of claim 2 , wherein the lighting state foreground feature extracted by the foreground feature extraction module comprises color and/or a light intensity of the lighting device, and/or a light intensity of a monitored area; and the working condition judgment module judges, based on the color and/or the light intensity of the lighting device and/or the light intensity of the monitored area, whether the lighting device is normal.

4. The monitoring system of claim 2 , wherein the working condition judgment module is further configured to judge, based on the lighting state foreground feature of the foreground object, whether a specific lighting device is normal, and if the judgment result is “yes”, indicate the judgment, based on the image data processed currently, on whether the lighting device is in a normal state or indicate the judgment result of whether the lighting device corresponding to the image data processed currently is in a normal state.

5. The monitoring system of claim 2 , wherein the working condition judgment module is further configured to determine that the lighting device is in an abnormal state, when a judgment of at least two successive pieces of image data indicate that the lighting device is in an abnormal state.

6. The monitoring system of claim 2 , wherein the imaging sensor senses at intervals of a predetermined time period to acquire image data of the lighting device in the predetermined time period, and provides the image data for the microcontroller for data processing.

7. The monitoring system of claim 2 , wherein the background acquisition module is configured to acquire a first background model based on image data sensed when the lighting device is in a lighting state, or acquire a second background model based on image data sensed when the lighting device is in a non-lighting state, or acquire a third background model group based on image data sensed when the lighting device is in a lighting state with multiple specific light intensities.

8. The monitoring system of claim 2 , wherein there are multiple imaging sensors, which are arranged along a length direction of the passenger conveyor.

9. The monitoring system of claim 2 , wherein the monitoring system further comprises an alarm unit, and the working condition judgment module triggers the alarm unit to work when determining that the lighting device is abnormal.

10. The monitoring system of claim 2 , wherein, the monitoring system further comprises a learning module, the learning module being configured to monitor a lighting state foreground feature of the lighting device of the passenger conveyor under a daily operation condition, to update the background model acquired by the background acquisition module.

11. The monitoring system of claim 1 , wherein the imaging sensor is integrated in an RGB-D sensor, and the RGB-D sensor further comprises a depth sensing sensor.

12. The monitoring system of claim 1 , wherein the microcontroller is further configured to trigger, when the working condition judgment module determines that the lighting device is in an abnormal state, outputting of a signal to the passenger conveyor and/or an elevator maintenance center of a building to prevent occurrence of a safety accident.

13. The monitoring system of claim 1 , wherein the lighting device comprises one or any combination of a traffic flow lamp, a comb lamp, a step lamp, a handrail lamp, and a barrier lamp.

14. A monitoring method for a passenger conveyor, comprising:
an image acquisition step: sensing a lighting device of the passenger conveyor to acquire image data;
a background acquisition step: acquiring a background model based on image data sensed when the lighting device is in a normal state or in an abnormal state;
a foreground detection step: comparing image data sensed in real time with the background model to obtain a foreground object; and
a working condition judgment step: performing data processing at least based on the foreground object to judge whether the lighting device is in a normal state.

15. The monitoring method of claim 14 , further comprising:
a foreground feature extraction step: extracting a corresponding lighting state foreground feature from the foreground object according to the lighting device;
wherein, in the working condition judgment step, whether the lighting device is in a normal state is judged based on the lighting state foreground feature.

16. The monitoring method of claim 15 , wherein, the extracted lighting state foreground feature comprises color and/or a light intensity of the lighting device, and/or a light intensity of a monitored area; and in the working condition judgment step whether the lighting device is normal is judged based on the color and/or the light intensity of the lighting device and/or the light intensity of the monitored area.

17. The monitoring method of claim 16 , wherein, in the working condition judgment step, when judging whether the lighting device is in a normal state is judging whether the lighting device emits light, whether the lighting device is in a normal state is judged based on the color and/or the light intensity of the lighting device.

18. The monitoring method of claim 16 , wherein, in the working condition judgment step, when judging whether the lighting device is in a normal state is judging whether lighting brightness of the lighting device is suitable, whether the lighting device is in a normal state is judged based on the light intensity of the lighting device.

19. The monitoring method of claim 16 , wherein, in the working condition judgment step, when judging whether the lighting device is in a normal state is judging whether lighting brightness of the lighting device is suitable, whether the lighting device is in a normal state is judged based on the light intensity and the color of the lighting device.

20. The monitoring method of claim 16 , wherein, in the working condition judgment step, when judging whether the lighting device is in a normal state is judging whether lighting brightness of the lighting device is suitable, whether the lighting device is in a normal state is judged based on the light intensity of the monitored area.

21. The monitoring method of claim 16 , wherein, in the f

Assignees

• Otis Elevator Co

Inventors

• Li Qiang
• Zhao Jianwei
• Hu Zhaoxia
• Wang Longwen
• Fang Hui
• Jia Zhen
• Su Anna

Classifications

• B66B29/005

  Applications of security monitors · CPC title

• B66B25/006 Primary

  Monitoring for maintenance or repair (for security reasons B66B29/005) · CPC title

• B66B21/02

  Escalators · CPC title

• B66B25/003

  Methods or algorithms therefor · CPC title

• H05B37/0227

  Electricity · mapped topic