Industrial Sound Analysis

AI-based acoustic monitoring in production

The research activities in the field Industrial Sound Analysis are focused on the development of AI-based methods for automated acoustic monitoring of products and processes for use in in-line and end-of-line quality control, process monitoring and predictive maintenance.

 

Main use cases for acoustic monitoring:

Acoustic monitoring can be used in machining or welding, among other applications. Use cases are: Inline monitoring, process monitoring or predictive maintenance.

News

 

Research project

K-MIAAD

Acoustic detection of anomalies in industrial environments through multi-domain feature fusion.

 

Research project

AI-MAG

Acoustic inline testing in MAG robot welding for continuous weld seam inspection.

 

Research project

AIrBSound

Acoustic monitoring of transition structures on bridges

The potential of acoustic quality assessment in production

How do you use acoustic signals to assess quality?

Your car is a good example to show the potential of quality assessment based on acoustic signals. You know the familiar driving sound caused by the engine, tyre wear and airflow. But what do you feel when this noise changes? A rattling or grinding noise might worry you and make you wonder if your car is still safe to drive. You probably react to this unknown and unexpected condition by driving to the workshop or at least stopping your car. It's no different in industry. We analyse the sound of your product or production process and let you know when something is not working as expected.

In industry, wherever there is movement, there are audible sounds that indicate the quality of products or processes. At the Fraunhofer IDMT in Ilmenau, Germany, we develop AI-based methods for sound analysis - especially for the analysis of industrial sounds - and thus create innovative approaches for automated acoustic monitoring (amo) of products and processes. amo can be used along the entire value chain for quality assessment and offers added value where, for example, optical monitoring methods reach their limits.

Our team of scientists from the fields of data science, data analysis, software development and project management is therefore researching AI-based solutions for audio signal analysis. The innovation at amo is that the measurement data is processed without any connection to an external cloud, so our solutions can be used locally within the company or directly on the machine.

Challenges in sensor-based machine monitoring

Machine and plant manufacturers are faced with the challenge of providing their customers with comprehensive sensor-based machine monitoring. However, existing methods cannot solve all the problems that arise, such as unexpected downtime, continuous monitoring of the machine or evaluation of existing machine data. In addition, there is a shortage of specialists who know their machines so well that they can immediately identify faults by sound and take action if necessary.

AI-based acoustic monitoring

Components of a pilot project

  • Analysis and interpretation of the soundscape in the production environment
  • Create a customized setup to record the sounds
  • Systematically record acoustic signals
  • Select and apply analysis methods
  • Consideration of privacy and security issues
  • Evaluate the feasibility of acoustic monitoring for specific applications

The acoustic AI for joining processes.

We hear what you can't see!

 

Research project

AI-MAG

Acoustic inline testing in MAG robot welding for continuous weld seam inspection.

 

Research project

QualiBolS

Development of an AI-based in-line acoustic monitoring system for the quality of stud welded joints

 

Research project

AKoS

Acoustic inspection of weld seams of safety-critical components as part of quality assurance

Research project

ML-S-LeAF

Development of machine learning algorithms based on virtual sound data for lightweight construction for quality assurance in additive manufacturing.

 

Research project

e-LAS+

Multimodal quality assurance for production of electricity storage in safety-critical systems

The acoustic AI for cutting processes.

We hear what you can't see!

 

Research project

amoZFerg

Acoustic quality assurance in machining production

Acoustic AI for quality control.

We hear what you can't see!

 

Research project

K-MIAAD

Acoustic detection of anomalies in industrial environments through multi-domain feature fusion.

 

Research project

AIrBSound

Acoustic monitoring of transition structures on bridges

 

Research project

RapidKI

Intelligent inline control for green laser ablation processes

 

Research project

OptiStrick

Development of an AI-supported inline quality assurance system for optimizing highly flexible knitting technologies

 

Research project

SEC-Learn

Sensor Edge Cloud for federated learning

 

Research project

HybridDigital

Digitalization for efficient process selection and design of hybrid structures based on experimental and synthetic data

Research project

DIAMOSS-I

Development of an Intelligent, Automonitored Sound Sensor System for Harsh Industrial Conditions

 

Research project

ExtrudEAR

Mapping auditory perception and human expert knowledge to extruder process control

Examples of successfully completed feasibility studies

Monitoring Home Electronics with AI

Reference project with Procter & Gamble

We have developed AI algorithms to analyze the sound of home appliances for monitoring their condition with over 97% accuracy. This enables the use of interactive apps to track the status of household activities and the involved device leading to improved user guidance and higher customer satisfaction.

 

  • Condition monitoring of operational states of household devices
  • >97% detection accuracy in any environment
  • Robust to different device types
  • Integrated in iOS and Android apps

Our solution for optimized quality control of your manufacturing process

We support the implementation and deployment of AI-powered acoustic quality control systems in manufacturing processes, from project definition to operational use.

Project Scope

  • Defining the processes and quality characteristics of your manufacturing operations

Data Collection

  • Defining data types

Model Training

  • Patented analytical methods
  • Iterative optimization steps

Evaluation

  • Data availability and eligibility
  • Integration into existing processes

Our goal, your Benefit!

  • The maximum model accuracy depends on the complexity of the defect patterns and the variability in the production process.

Get in touch!

  • We will evaluate whether your quality assurance issue can be resolved through acoustic analysis.

With our technical solutions and services, we provide companies and institutions with concrete support and real added value for their use cases. Contact us to discuss your application!

 

Automatic acoustic monitoring of weld quality

Interested in further use cases?

Here you will find an overview of our use cases.

Our scientists exchange information within their research community and with stakeholders from industry and present current research results at scientific meetings and conferences. In addition, we regularly publish articles in professional journals that deal with application topics in our research field, including the German speaking magazines "Maschinenmarkt" or "Fertigungstechnik".

Jahr
Year
Titel/Autor:in
Title/Author
Publikationstyp
Publication Type
2025 Federated Semi-supervised Learning for Industrial Sound Analysis and Keyword Spotting
Grollmisch, Sascha; Köllmer, Thomas; Yaroshchuk, Artem; Lukashevich, Hanna
Konferenzbeitrag
Conference Paper
2025 MPEG Audio Coding for Machines
Sporer, Thomas; Kim, Sang-Wok
Konferenzbeitrag
Conference Paper
2025 Semi-supervised Learning for Acoustic Scene Classification using FixMatch
Grollmisch, Sascha; Kumar, Ravi; Abeßer, Jakob
Konferenzbeitrag
Conference Paper
2025 Bridging the Gap: GANs as a Solution for Data-Scarce Industrial Audio Classification
Ngamthipwatthana, Pitchapa; Gourishetti, Saichand; McLeod, Andrew; Grollmisch, Sascha
Konferenzbeitrag
Conference Paper
2024 Multimodale Fehlererkennung in Laserablationsprozessen
Talagini Ashoka, Anitha Bhat; Anding, Katharina
Zeitschriftenaufsatz
Journal Article
2024 Towards Measuring and Forecasting Noise Exposure at the VELTINS-Arena in Gelsenkirchen, Germany
Ngamthipwatthana, Pitchapa; Götze, Marco; Kátai, András; Abeßer, Jakob
Konferenzbeitrag
Conference Paper
2024 DOL3: Distilled OpenL3 audio embeddings for lightweight audio classification
Kehling, Christian; Gourishetti, Saichand
Konferenzbeitrag
Conference Paper
2024 Acoustic insights into the corn extrusion process for enhanced quality control
Gourishetti, Saichand; Chauhan, Jaydeep; Krüger, Tanja; Grollmisch, Sascha; Liebetrau, Judith; Bös, Joachim
Konferenzbeitrag
Conference Paper
2024 Selbstüberwachtes Vortraining zur Verbesserung automatischer Audioklassifikationsalgorithmen
Grollmisch, Sascha; Abeßer, Jakob; Bös, Joachim
Konferenzbeitrag
Conference Paper
2024 Aktuelle Forschungsschwerpunkte in der akustischen Ereignisdetektion
Abeßer, Jakob; Grollmisch, Sascha; Bös, Joachim
Konferenzbeitrag
Conference Paper
2023 Empirical Study on DED-Arc Welding Quality Inspection Using Airborne Sound Analysis
Chauhan, Jaydeep; Gourishetti, Saichand; Rohe, Maximilian; Sennewald, Martin; Hildebrand, Jörg; Bergmann, Jean Pierre
Konferenzbeitrag
Conference Paper
2023 Temporal Resolution of Acoustic Process Emissions for Monitoring Joint Gap Formation in Laser Beam Butt Welding
Kodera, Sayako; Schmidt, Leander; Römer, Florian; Schricker, Klaus; Gourishetti, Saichand; Böttger, David; Krüger, Tanja; Kátai, András; Straß, Benjamin; Wolter, Bernd; Bergmann, Jean Pierre
Zeitschriftenaufsatz
Journal Article
2023 Ohren für Schweißroboter
Breitbarth, Kati; Krüger, Tanja; Liebetrau, Judith
Zeitschriftenaufsatz
Journal Article
2023 Automated Quality Inspection in Additive Manufacturing for Lightweight Construction: A New Approach Based on Virtual Sonic Data and Machine Learning (ML-S-LeAF)
Yildiz, Ömer Faruk; Fritz, Alexander; Storch, Julian; Kátai, András; Ribecky, Sebastian; Hofmann, Peter; Talagini Ashoka, Anitha Bhat; Fassbender, Rene; Marckmann, Hannes; Grollmisch, Sascha; Jansen, Stefan; Adams, Christian; Kroh, Irina; Zaleski, Olgierd; Manohar, Aswin; Keuchel, Sören; Schröder, Thorben; Ren, Yaxiong; Boni, Christiano de; Balestra, Italo; Bös, Joachim; Ferretti, Raphael; Schötz, Johannes; Merschroth, Holger; Gross, Peter; Weigold, Matthias
Konferenzbeitrag
Conference Paper
2023 Arc Welding Process Monitoring Using Neural Networks and Audio Signal Analysis
Gourishetti, Saichand; Chauhan, Jaydeep; Grollmisch, Sascha; Rohe, Maximilian; Sennewald, Martin; Hildebrand, Jörg; Bergmann, Jean Pierre
Konferenzbeitrag
Conference Paper
2023 Acoustic data acquisition for quality monitoring during Powder Bed Fusion with Laser Beam (PBF-LB)
Ren, Yaxiong; Adams, Christian; Gross, Peter; Talagini Ashoka, Anitha Bhat; Kátai, András; Weigold, Matthias; Melz, Tobias
Konferenzbeitrag
Conference Paper
2023 Monitoring of Joint Gap Formation in Laser Beam Butt Welding Using Neural Network-Based Acoustic Emission Analysis
Gourishetti, Saichand; Schmidt, Leander; Römer, Florian; Schricker, Klaus; Kodera, Sayako; Böttger, David; Krüger, Tanja; Kátai, András; Bös, Joachim; Straß, Benjamin; Wolter, Bernd; Bergmann, Jean Pierre
Zeitschriftenaufsatz
Journal Article
2022 Intelligentes akustisches Monitoring durch ausgewählte Mikrofonierungskonzepte
Fritsch, Tobias; Bös, Joachim; Grollmisch, Sascha; Gourishetti, Saichand; Hofmann, Peter; Liebetrau, Judith
Konferenzbeitrag
Conference Paper
2022 Potentials and Challenges of AI-based Audio Analysis in Industrial Sound Analysis
Gourishetti, Saichand; Grollmisch, Sascha; Abeßer, Jakob; Liebetrau, Judith
Konferenzbeitrag
Conference Paper
2021 Improving Semi-Supervised Learning for Audio Classification with FixMatch
Grollmisch, Sascha; Cano, Estefanía
Zeitschriftenaufsatz
Journal Article
2021 The Sounds of Partial Discharge
Gourishetti, Saichand; Werner, Sara; Kátai, András; Liebetrau, Judith
Konferenzbeitrag
Conference Paper
2021 Investigating the influence of microphone mismatch for acoustic traffic monitoring
Gourishetti, Saichand; Abeßer, Jakob; Grollmisch, Sascha; Kátai, András; Liebetrau, Judith
Konferenzbeitrag
Conference Paper
2021 Partial discharge monitoring using deep neural networks with acoustic emission
Gourishetti, Saichand; Johnson, David; Werner, Sara; Kátai, András; Holstein, Peter
Konferenzbeitrag
Conference Paper
2021 Investigation of the directional characteristics of the emitted airborne sound by Friction Stir Welding for online process monitoring
Bös, J.; Katai, A.; Grätzel, M.; Other, S.; Stoll, B.; Rohe, M.; Hasieber, M.; Löhn, T.; Hildebrand, J.; Bergmann, J.P.; Breitbarth, K.
Poster
2021 IDMT-Traffic: An Open Benchmark Dataset for Acoustic Traffic Monitoring Research
Abeßer, Jakob; Gourishetti, Saichand; Kátai, András; Clauß, Tobias; Sharma, Prachi; Liebetrau, Judith
Konferenzbeitrag
Conference Paper
2020 Techniques improving the robustness of deep learning models for industrial sound analysis
Grollmisch, S.; Johnson, D.S.
Konferenzbeitrag
Conference Paper
2020 IAEO3 - Combining OpenL3 Embeddings and Interpolation Autoencoder for Anomalous Sound Detection
Grollmisch, Sascha; Johnson, David; Abeßer, Jakob; Lukashevich, Hanna
Vortrag
Presentation
2020 Visualizing Neural Network Decisions for Industrial Sound Analysis
Grollmisch, Sascha; Johnson, David; Liebetrau, Judith
Konferenzbeitrag
Conference Paper
2020 Plastic Material Classification using Neural Network based Audio Signal Analysis
Grollmisch, Sascha; Johnson, David; Krüger, Tobias; Liebetrau, Judith
Konferenzbeitrag
Conference Paper
2020 Compressed air leakage detection using acoustic emissions with neural networks
Johnson, D.; Kirner, J.; Grollmisch, Sascha; Liebetrau, Judith
Konferenzbeitrag
Conference Paper
2019 Anwendung von (Luft-)Schallanalyse als ein Verfahren der berührungslosen Qualitätssicherung für die vorausschauende Wartung
Kepplinger, Sara; Helbig, Mareike; Clauss, Tobias; Lukashevich, Hanna
Konferenzbeitrag
Conference Paper
2018 Störschallunterdrückung bei Luftschallanalysen in industriellen Fertigungsstrecken
Nowak, Johannes; Grollmisch, Sascha; Cano, Estefanía; Lukashevich, Hanna; Liebetrau, Judith
Konferenzbeitrag
Conference Paper
2018 Luftschallbasierte Rissdetektion von Metallteilen
Liebetrau, Judith; Grollmisch, Sascha; Nowak, Johannes
Konferenzbeitrag
Conference Paper
2018 Stadtlärm - a distributed system for noise level measurement and noise source identification in a smart city environment
Clauß, Tobias; Abeßer, Jakob; Lukashevich, Hanna; Gräfe, Robert; Häuser, Franz; Kühn, Christian; Sporer, Thomas
Konferenzbeitrag
Conference Paper
Diese Liste ist ein Auszug aus der Publikationsplattform Fraunhofer-Publica

This list has been generated from the publication platform Fraunhofer-Publica
 

Public Audio Datasets

Fraunhofer IDMT has compiled further audio data sets for various research areas such as instrument recognition, fingerings or game analysis.

 

Industrieschweißen

Our use cases

We develop AI algorithms for acoustic monitoring of welding and machining processes to improve quality and efficiency in production. Contact us if you want to optimise your quality assurance together with us!

 

Zerspanen