Transparent Multi-Site Data Analysis Workflows for Earth Observation (B05)

• Subject Area: Security and Dependability, Operating-, Communication- and Distributed Systems ; Data Management, Data-Intensive Systems, Computer Science Methods in Business Informatics ; Geodesy, Photogrammetry, Remote Sensing, Geoinformatics, Cartography
• Term: since 2020
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 414984028

DAWs for satellite-based Earth observation (EOW) are characterized by large data volumes and high heterogeneity and complexity of the analysis steps. Appropriate scheduling of such work-flows must be adaptive and consider the location of data files, which exceeds the capabilities of common scheduling engines. We overcame this limitation in FONDA I by designing a location-aware scheduling algorithm, which makes porting and adapting EOWs much easier. However, many current EOWs require huge input datasets making downloads infeasible, while datasets are often distributed across different online platforms. We will accordingly research the foundations of a federated, multi-center enabled EOW engine and exploit this federated design to answer crucial questions on long-term changes of agricultural land due to its importance for food security and sustainability.

• DFG Programme: Collaborative Research Centres
• Subproject of: SFB 1404: FONDA - Foundations of Workflows for Large-Scale Scientific Data Analysis
• Applicant Institution: Humboldt-Universität zu Berlin
• Project Heads: Professor Dr. Patrick Hostert; Professor Dr. Ulf Leser