Abnormal sound diagnosis system

Patent metadata

Field	Value
Publication number	US-12401959-B2
Application number	US-202318095232-A
Country	US
Kind code	B2
Filing date	Jan 10, 2023
Priority date	Jan 25, 2022
Publication date	Aug 26, 2025
Grant date	Aug 26, 2025

Abstract

An abnormal sound diagnosis system includes a sound acquisition unit configured to acquire data of a sound generated from an object, an inquiry information acquisition unit configured to acquire inquiry information regarding an abnormal sound generated in the object, an arithmetic processing unit configured to acquire a spectrogram indicating a relationship among a time, a frequency, and sound pressure from the data of the sound, an extraction unit configured to acquire, based on the inquiry information acquired by the inquiry information acquisition unit, an inferred frequency range of the abnormal sound generated in the object and extract an extracted range corresponding the inferred frequency range of the spectrogram acquired by the arithmetic processing unit, and a diagnosis unit configured to diagnose, based on the extracted range of the spectrogram extracted by the extraction unit, a cause of the abnormal sound generated in the object.

First claim

What is claimed is:

1. An abnormal sound diagnosis system configured to diagnose an abnormal sound generated in a vehicle configured for mobility, the abnormal sound diagnosis system comprising:
a processor configured to:
acquire data of a sound generated from the vehicle, the data of the sound generated from the vehicle is acquired from a microphone configured to transform sound pressure into the data of the sound;
acquire inquiry information regarding the abnormal sound generated in the vehicle;
acquire a spectrogram indicating a relationship among a time, a frequency, and the sound pressure from the data of the sound;
acquire, based on the inquiry information, an inferred frequency range of the abnormal sound generated in the vehicle;
extract an extracted range corresponding to the inferred frequency range of the spectrogram; and
diagnose, based on the extracted range of the spectrogram, a cause of the abnormal sound generated in the vehicle, by a neural network constructed by a supervised learning such that the cause of the abnormal sound generated in the vehicle or a part that is a source of the abnormal sound is diagnosed, based on the inquiry information acquired.

2. The abnormal sound diagnosis system according to claim 1 , further comprising a server having a storage device that stores an onomatopoeia in association with a frequency range for each of abnormal sounds generated in the vehicle, wherein:
the inquiry information includes information on the onomatopoeia similar to the abnormal sound generated in the vehicle; and
the processor is further configured to acquire, as the inferred frequency range, the frequency range corresponding to the onomatopoeia in the inquiry information from information stored in the storage device.

3. The abnormal sound diagnosis system according to claim 2 , wherein:
the inquiry information includes a generation place of the abnormal sound;
the storage device stores at least one of onomatopoeias in association with a plurality of generation places and the frequency range of the abnormal sound in each of the generation places; and
the processor is further configured to acquire, as the inferred frequency range, the frequency range corresponding to the onomatopoeia and the generation place in the inquiry information from the information stored in the storage device.

4. The abnormal sound diagnosis system according to claim 1 , further comprising a display configured to display the extracted range extracted by the processor, wherein
a selection is allowed to a user about a desired range of the spectrogram displayed on the display.

5. The abnormal sound diagnosis system according to claim 4 , wherein:
the processor is further configured to diagnose the cause of the abnormal sound based on the data of the sound, the inquiry information, and the inferred frequency range or a selected range; and
the selected range is a range selected by the user from the extracted range displayed on the display.

6. The abnormal sound diagnosis system according to claim 1 , wherein the processor is further configured to:
extract a second frequency where the sound pressure is changed by a value equal to or higher than a predetermined value between a first time period and a second time period,
wherein the frequency extracted where the sound pressure is changed by the value equal to or higher than the predetermined value between the first time period and the second time period is determined in advance for each of a plurality of frequencies in the spectrogram between a generation time period in which a physical quantity of a vehicle state information matches a physical quantity included in the inquiry information and a time period in which the physical quantity of the vehicle state information does not match the physical quantity included in the inquiry information.

7. An abnormal sound diagnosis system configured to diagnose an abnormal sound generated in an vehicle configured for mobility, the abnormal sound diagnosis system comprising:
a processor configured to:
acquire data of a sound generated from the vehicle, the data of the sound generated from the vehicle is acquired from a microphone configured to transform sound pressure into the data of the sound;
acquire inquiry information on the abnormal sound generated in the vehicle;
acquire a relationship between a time and the sound pressure from the data of the sound;
acquire, based on the inquiry information, a generation time period in which the abnormal sound is generated in the vehicle;
extract an extracted range corresponding to the generation time period of the relationship between the time and the sound pressure; and
diagnose, based on the extracted range of the relationship between the time and the sound pressure, a cause of the abnormal sound generated in the vehicle, by a neural network constructed by a supervised learning such that the cause of the abnormal sound generated in the vehicle or a part that is a source of the abnormal sound is diagnosed, based on the inquiry information acquired.

8. The abnormal sound diagnosis system according to claim 7 , wherein the processor is further configured to:
acquire a state of the vehicle in synchronization with acquiring the data of the sound, wherein:
the inquiry information includes information on the state of the vehicle when the abnormal sound is generated; and
acquire, as the generation time period, a time period in which the state of the vehicle matches the state of the vehicle in the inquiry information among an acquisition time range of the data of the sound.

9. The abnormal sound diagnosis system according to claim 8 , wherein:
the processor is further configured to:
acquire a spectrogram indicating a relationship among the time, a frequency, and the sound pressure from the data of the sound;
extract a second frequency where the sound pressure is changed by a value equal to or higher than a predetermined value between a first time period and a second time period;
the first time period is a time period in which the state of the vehicle matches the state of the vehicle in the inquiry information; and
the second time period is a time period in which the state of the vehicle does not match the state of the vehicle in the inquiry information.

10. The abnormal sound diagnosis system according to claim 9 , wherein the second frequency extracted where the sound pressure is changed by the value equal to or higher than the predetermined value between the first time period and the second time period is determined in advance for each of a plurality of frequencies in the spectrogram between the generation time period in which a physical quantity of a vehicle state information matches a physical quantity included in the inquiry information and a time period in which the physical quantity of the vehicle state information does not match the physical quantity included in the inquiry information.

11. The abnormal sound diagnosis system according to claim 8 , wherein:
the state of the vehicle includes at least one of a driving state of the vehicle and a physical quantity changed when the vehicle travels.

12. The abnormal sound diagnosis system according to claim 11 , wherein the at least one of the driving state of the vehicle is selected from a starting, an idling, a stopping, an accelerating, a constant speed traveling, a decelerating, a braking, a reversing, a turning, a motor traveling, and a hybrid traveling of the vehicle.

13. The abnormal sound diagnosis system according to claim 11 , wherein the physical quantity is a vehicle speed of the vehicle, the driving state of the vehicle, a warm-up effec

Assignees

• Toyota Motor Co Ltd

Inventors

• Ueda Yu

Classifications

• G10L25/18

  the extracted parameters being spectral information of each sub-band · CPC title

• G07C5/0808

  Diagnosing performance data (testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005) · CPC title

• G07C5/0833

  using audio means · CPC title

• G10L25/30

  using neural networks · CPC title

• H04R29/008 Primary

  Visual indication of individual signal levels (visual indication of stereophonic sound image H04S7/40) · CPC title