Machine listening for smart decisions

What do mechanical connections that click into place and approaching emergency vehicles have in common?

 

Both cause acoustic signals that provide valuable information. In addition, they represent scenarios that are difficult to monitor using visual or haptic methods. With the help of machine learning and artificial intelligence, we record and interpret acoustic signals and automatically derive smart recommendations for action. This enables optimized processes and innovative human-technology interactions in a wide range of application fields.

AI-supported acoustic sensor systems for the automotive sector

The Hearing Car Erprobungsfahrzeug mit einem weiteren Auto mit Martinshorn auf der Teststrecke
© Fraunhofer IDMT/Anika Bödecker
The Hearing Car features intelligent systems for acoustic event detection, such as sirens from emergency vehicles.

In the automotive sector, we are researching innovative acoustic functions. These include scene recognition, for example for the siren of an approaching emergency vehicle or a nail in a tire. Acoustic sensors at various points in and on the car send data to an analysis unit. Recordings from the wheel arch, for example, can provide information about the condition of the road and enable automatic chassis adjustments to be made to the suspension or brake system. Continuous acoustic monitoring of the car's operating noises also allows damage or wear to be detected. An “uneven” engine running or worn brakes can be identified in advance, which is referred to as predictive maintenance. This enables smart maintenance intervals and repairs before breakdowns or even accidents occur. The Hearing Car thus makes an important contribution to research into autonomous driving.

Detect and monitor bodily sounds

Detektion von Körpergeräuschen
© Adobe Stock/ziehefzie
Deep learning algorithms are used to classify bodily sounds.

Bodily sounds can provide clues about someone's health. That is why we are conducting research into the long-term monitoring of bowel sounds using a multi-channel acoustic sensor. The aim is to gather information that could enable the early detection of post-operative complications, for example. The sensor is intended to be used during and after surgery to record body sounds in general and intestinal sounds in particular over a long period of time.

Acoustic process monitoring

© Fraunhofer IDMT/Anika Bödecker
Fraunhofer IDMT is also conducting research into condition monitoring of pneumatic systems for the early and automated detection of compressed air leaks.

In addition, acoustic monitoring systems from Fraunhofer IDMT-HSA detect machine damage in industry and plant engineering before it occurs. This prevents downtime and makes maintenance more predictable (predictive maintenance). In addition, noises occurring in many areas can be assigned to specific events. In quality assurance and end-of-line inspection in industrial production, audible damage, such as the smallest material fractures in computer chip manufacturing, can be detected.

Our services for you:

 

  • Development of application- and customer-specific recognition technologies that recognize individual events and entire scenes, e.g., mechanical connections that click into place or the detection of a wet surface while driving.
  • Embedding signal processing in hardware systems (microprocessor and DSP), sensor networks and complex system architectures - as an uncomplicated retrofit solution in existing infrastructures, directly in your new product and in mobile applications (apps)
  • Conceptual design and implementation of the optimal microphoning and signal pre-processing for your use case
  • Training and customization of developed sensor systems
  • Your door opener for new service models: Use our smart sensor technology so that your customers can concentrate on their own core business - how about »Reliable Machine Performance as a Service«, for example?

We offer you robust acoustic recognition systems that function reliably even under demanding conditions, without an Internet connection, and at a great distance from the microphone. This ensures a particularly robust, secure and reliable application - even with the highest demands on data protection and data security. Contact us!

Insights into research and practice

 

Multimodal data acquisition for The Hearing Car

Intelligent measurement technology for recording acoustically perceptible noises in and around vehicles

 

»Click«

We at Fraunhofer IDMT in Oldenburg are making a concrete contribution to AI support for shopfloor management on the basis of automated data processing with intelligent ears for automated and contact-free production control.

 

»The Hearing Car«

Especially in the development of autonomous vehicles, acoustic sensors are a key component. In combination with optical sensors, the car’s sense of hearing ensures greater safety and reliability in road traffic – for example through intelligent siren recognition and localization.

 

Press Release / 18.5.2022

Under pressure...

Hannover Messe 2022: Detecting pneumatic actuator leakage by means of intelligent audio technology and innovative AI methods

 

Project KI-MUSIK 4.0

Universal AI Sensor Interface for Industry 4.0

This project is dedicated to the next generation of intelligent, increasingly autonomous manufacturing systems.

 

Project IMPASA

Ears for the machine hall

Intelligent acoustic monitoring platforms and sensor networks for use in industrial applications.

 

All solutions at a glance

Here you can find further information about our solutions of the Oldenburg Branch for Hearing, Speech and Audio Technology HSA.

R&D-Services and Licencing

Please contact us in case you are interested in our expertise and services.