Multimodal Sensor Fusion and Bio-Signal Processing for Vital Sign Estimation (UNOSECO)

• Applicant: Professor Dr.-Ing. Steffen Leonhardt
• Subject Area: Epidemiology and Medical Biometry/Statistics ; Electronic Semiconductors, Components and Circuits, Integrated Systems, Sensor Technology, Theoretical Electrical Engineering ; Medical Physics, Biomedical Technology
• Term: from 2016 to 2021
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 313380423

The goal of this project is the investigation of methods of multimodal bio-signal processing for vital sign estimation. The focus lies on the development of a methodology that is independent of the sensing method and especially considers non-contact and unobtrusive modalities, which in general are very susceptible to disturbances. However, in contrast to traditional clinical instrumentation they can potentially be integrated into objects of everyday life. For this, a unified, macroscopic model of bio-signal generation is necessary. Our approach proposes the generation of cardiac signals from a virtual source. This virtual source signal is transmitted through virtual channels, at the end of which a real physical signal such as electrocardiogram, photoplethysmogram or ballistocardiogram can be measured. The first goal of this project is answering the question which assumptions have to be made about such a source-filter model for the generation of cardiac and later even respiratory signals. Based on these assumptions, existing signal processing methods will be evaluated and adapted or created from scratch. If the proposed source-filter model is adapted for each subject, two advantages arise: First, model-based sensor-fusion becomes possible. Second, diagnostic information can potentially be extracted from the adapted model parameters. To validate the proposed model and to test signal processing methods, a simulation environment for multimodal bio-signal and their distortions needs to be created. Additionally, real measurement data needs to be recorded. For this, several unobtrusive sensing modalities already available at the institute need to be integrated into a unified multimodal measurement setup. In addition to the recording of clean data, this setup will allow the generation of various, reproducible artifacts. The recorded measurements and reference data will be provided to the public via UNOVIS, the "MedIT Public Unobtrusive Vital Sign Database". Hence, the overall goal of this project is the generation of general methods and structures to advance research in the area of unobtrusive vital signs estimation. In subsequent projects, these methods and structures can be applied to different areas of applications and pathologies.

• DFG Programme: Research Grants