Systems and methods for analyzing and displaying acoustic data

Patent metadata

Field	Value
Publication number	US-11960002-B2
Application number	US-201917262497-A
Country	US
Kind code	B2
Filing date	Jul 24, 2019
Priority date	Jul 24, 2018
Publication date	Apr 16, 2024
Grant date	Apr 16, 2024

Abstract

Some systems include an acoustic sensor array configured to receive acoustic signals, an electromagnetic imaging tool configured to receive electromagnetic radiation, a user interface, a display, and a processor. The processor can receive electromagnetic data from the electromagnetic imaging tool and acoustic data from the acoustic sensor array. The processor can generate acoustic image data of the scene based on the received acoustic data, generate a display image comprising combined acoustic image data and electromagnetic image data, and present the display image on the display. The processor can receive an annotation input from the user interface and update the display image based on the received annotation input. The processor can be configured to determine one or more acoustic parameters associated with the received acoustic signal and determine a criticality associated with the acoustic signal. A user can annotated the display image with determined criticality information or other determined information.

First claim

The invention claimed is:

1. An acoustic analysis system comprising:
an acoustic sensor array comprising a plurality of acoustic sensor elements, each of the plurality of acoustic sensor elements being configured to receive acoustic signals from an acoustic scene and output acoustic data based on the acoustic signals;
an electromagnetic imaging tool configured to receive electromagnetic radiation from a target scene and output electromagnetic image data representative of the electromagnetic radiation; and
a processor in communication with the acoustic sensor array and the electromagnetic imaging tool, the processor being configured to:
receive electromagnetic image data from the electromagnetic imaging tool;
receive acoustic data from the acoustic sensor array;
generate acoustic image data of the acoustic scene based on the acoustic data;
generate a display image comprising combined acoustic image data and electromagnetic image data;
receive an annotation input from a user; and
update the display image based on the annotation input.

2. The acoustic analysis system of claim 1 , wherein:
the annotation input comprises at least one of: a freestyle annotation, one or more icons, an alphanumeric annotation, or a predefined shape.

3. The acoustic analysis system of claim 1 , wherein the processor is configured to:
detect a location of an acoustic signal present in the acoustic scene; and
wherein updating the display image based on the annotation input comprises:
including an indicator in the display image positioned at the location of the acoustic signal; and
adjusting a transparency of the indicator within the display image in response to a annotation input associated with the transparency of the indicator, wherein adjusting the transparency of the indicator within the display image comprises adjusting a blending ratio corresponding to blending the electromagnetic imaging data and the acoustic image data.

4. The acoustic analysis system of claim 1 , wherein the processor is configured to:
detect a location of an acoustic signal present in the acoustic scene; and
determine an acoustic parameter associated with the acoustic signal; and
wherein:
the annotation input comprises receiving a selection of a range of values associated with the acoustic parameter; and
updating the display image based on the annotation input comprises including an indicator in the display image positioned at the location of the acoustic signal only if the acoustic parameter associated with the acoustic signal falls within the range of values associated with the acoustic parameter.

5. The acoustic analysis system of claim 1 , wherein the processor is configured to:
detect a location of an acoustic signal present in the acoustic scene; and
determine a distance to target associated with the acoustic signal; and
wherein:
the display image includes an indicator positioned at the location of the acoustic signal; and
updating the display image based on the annotation input comprises including, proximate the indicator positioned at the location of the acoustic signal, an annotation indicating the distance to target associated with the acoustic signal.

6. The acoustic analysis system of claim 5 , wherein the processor is configured to:
determine one or more acoustic parameters associated with the acoustic signal; and
determine a criticality associated with the acoustic signal based on a comparison of the acoustic parameter to a predetermined threshold or plurality of predetermined thresholds; and
wherein updating the display image based on the annotation input further comprises including, proximate the indicator positioned at the location of the acoustic signal, an annotation indicating the one or more acoustic parameters and the criticality associated with the acoustic signal.

7. The acoustic analysis system of claim 5 , further comprising a laser distance sensor comprising a laser pointer configured to emit a laser toward the target scene and provide information to the processor representative of the distance to the target scene,
wherein the display image further includes a laser indicator showing a position of the laser within the target scene.

8. The acoustic analysis system of claim 1 , wherein the processor is further configured to:
detect a plurality of acoustic signals within the acoustic scene; and
determine a first acoustic parameter associated with each of the plurality of acoustic signals; and
wherein:
receiving the annotation input from the user comprises receiving instructions to update the display image to include information representative of the first acoustic parameter; and
updating the display image based on the annotation input comprises including an indication on the display image representing the first acoustic parameter associated with each of the plurality of acoustic signals.

9. The acoustic analysis system of claim 8 , wherein the indication on the display image representing the first acoustic parameter associated with each of the plurality of acoustic signals comprises an isoacoustic indicator positioned at a location of each acoustic signal and including a single color, the single color representing a particular value or range of values associated with the first acoustic parameter.

10. The acoustic analysis system of claim 9 , wherein the single color of each isoacoustic indicator represents a criticality level of the first acoustic parameter.

11. The acoustic analysis system of claim 9 , wherein the processor is configured to determine a second acoustic parameter associated with each of the plurality of acoustic signals, and wherein each isoacoustic indicator represents a particular value or range of the first acoustic parameter and the second acoustic parameter.

12. The acoustic analysis system of claim 8 , wherein the indication comprises:
for each acoustic signal of the plurality of acoustic signals, an indicator positioned on the display image at a location in the acoustic scene corresponding to the acoustic signal, the indicator having a visual characteristic representing the first acoustic parameter of the acoustic signal; and
a multi-parameter representation showing a relationship between the first acoustic parameter and a second acoustic parameter within the acoustic scene.

13. The acoustic analysis system of claim 12 , wherein the multi-parameter representation includes a time axis showing evolution of the relationship between the first acoustic parameter and the second acoustic parameter over time.

14. The acoustic analysis system of claim 1 , further comprising a memory including one or more sound profiles, each sound profile being defined by one or more acoustic parameters corresponding to one or more sounds,
wherein the processor is configured to:
analyze the acoustic data; and
if the acoustic data matches one of the sound profiles stored in memory, annotate the display image with an annotation associated with the sound profile; and

wherein the annotation input comprises an instruction to detect a sound profile present in the acoustic scene.

15. The acoustic analysis system of claim 14 , wherein the annotation comprises an indication of a detected condition of the acoustic scene based on the matched sound profile.

16. The acoustic analysis system of claim 15 , wherein:
the detected condition comprises an air leak;
the processor is further configured to determine a cost associated with the air leak; and
the indication comprises an alphanumeric annotation, the alphanumeric annotation comprising a representation of the cost associa

Assignees

• Fluke Corp

Inventors

• Stuart Michael D
• Prabhakar Dileepa
• Tsukamaki Scott M
• Witt Darwin C

Classifications

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• G01M3/022

  Test plugs for closing off the end of a pipe · CPC title

• H04N23/95

  Computational photography systems, e.g. light-field imaging systems · CPC title

• H04S7/40

  Visual indication of stereophonic sound image · CPC title

• H04S7/301

  Automatic calibration of stereophonic sound system, e.g. with test microphone · CPC title