WP3. AI-based distributed algorithms for multimodal perception and situational awareness
25 months, June 1st 2021 to June 30th 2023
MARVEL will deliver an AI-based framework that will provide multimodal perception of audio-visual scenes and will employ advanced Machine Learning model distribution and decision offloading mechanisms. These techniques will enable fast reaction to data streams and will help decision makers gain situational awareness in short times. The WP3 objectives are to
- define and execute measures ensuring privacy preservation during data processing.
- follow a personalized federated learning approach to train and execute ML models at the Edge, Fog and Cloud.
- train new or updated ML algorithms for audio-visual classification and analytics.
- optimise ML deployment in the E2F2C infrastructure in a continuous manner.
- deploy ML algorithms at all layers of E2F2C.
- implement light-weight ML models for deployment at the edge.
|No||Title||Leader||Type||Download link||Due Date|
|D3.1||Multimodal and privacy-aware audio-visual intelligence – initial version||AU||Demo||To be released||M06, June 30th, 2021|
|D3.2||Efficient deployment of AI-optimised ML/DL models – initial version||FORTH||Demo||To be released||M18, June 30th, 2022|
|D3.3||E2F2C Privacy preservation mechanisms||FBK||Demo||To be released||M18, June 30th, 2022|
|D3.4||MARVEL’s federated learning realization||UNS||Demo||To be released||M30, June 30th, 2023|
|D3.5||Multimodal and privacy-aware audio-visual intelligence – final version||AU||Demo||To be released||M36, Dec 31st, 2023|
|D3.6||Efficient deployment of AI-optimised ML/DL models – final version||FORTH||Demo||To be released||M36, Dec 31st, 2023|
- Project Coordinator: Dr. Sotiris Ioannidis
- Institution: Foundation for Research and Technology Hellas (FORTH)
- E-mail: firstname.lastname@example.org
- Start: 01.01.2021
- Duration: 36 months
- Participating Organisations: 17
- Number of countries: 12
This project has received funding from the European Union’s Horizon 2020 Research and Innovation program under grant agreement No 957337. The website reflects only the view of the author(s) and the Commission is not responsible for any use that may be made of the information it contains.