AudioCAT - competence assessment via voice-controlled computer dialogue systems

© Adobe Stock/Mediteraneo

Professional language skills are an important basis for effective communication and successful teamwork. The AudioCAT project addresses this by developing an automated process for evaluating language skills.

Objectives and procedure

The AudioCAT system to be developed in the project is intended to help prospective nursing staff and doctors to demonstrate their own professional language skills in realistic situations. The system will provide practical tasks via a screen while at the same time conducting a spontaneous and authentic conversation with the test taker. The specialist knowledge and soft skills are evaluated in the background. The research focus of the project is also on the automatic recognition of non-native English utterances, on intelligent and authentic computer dialogues and on algorithms for evaluating competencies and soft skills such as resilience under stress. Soft skills are important for groups with different native languages and a variety of cultural backgrounds. The competencies of a successful team work are, for example, active listening, experience with handling stress, a solution-oriented approach, decision-making ability and an affinity for transparent communication.

The automated speech recognition technology developed by Fraunhofer IDMT in Oldenburg, which has been integrated into the application can recognise spoken words and sentences. The technology outputs them as text. With the help of the transcribed text, answers are analysed, classified and evaluated on the basis of machine learning methods.

The aim of the project partners is to support staff evaluation in the long term by providing a competence assessment tool for the medical sector. The simulated dialogue with the system can already be tested on the website: www.audiocat.de

Innovations and perspectives

The introduction of a computer dialogue system and automated competence testing enables an objective and efficient evaluation of technical and soft skills under realistic conditions and provides a completely new type of competence testing. 

Even though the funding phase has ended, the project partners are continuing to optimise the AudioCAT system.

Further Information

 

Press Release / 22.3.2023

Competence assessment tool for the medical sector

Speech-controlled dialogue system for assessing communication and teamwork skills in medicine and patient care

 

»Help!«

Reliable detection of calls for help and critical events - at home and at work

 

Speech Assistance for Citizen Services

Interaction with authorities is often complex and lengthy. Can long waiting times and the time-consuming filling out of applications be avoided? With the combination of intelligent speech recognition and an engine for semantic processing.

 

Connected Health

The work area Connected Health dedicates its research and development activities to sensor-based health systems that can be deployed flexibly and without clinical infrastructure.

 

Press Release / 4.11.2021

Speech recognition for the hospitality sector

Fraunhofer IDMT from Oldenburg is contributing its know-how in the integration of speech recognition.

 

Press Release / 15.2.2023

Intuitive machine control using speech recognition

Hannover Messe Preview: Our speech recognition solution for use in industrial manufacturing

The project AudioCAT has been funded by the German ministry of education and research (BMBF).

Speech Recognition for Products and Processes

The speech recognition technology of the Fraunhofer IDMT in Oldenburg functions robustly - with and without an internet connection.