Eirik Østmo / Torger Grytå

VI seminar 2021 #6 - Deep Learning meets Modeling: Taking the Best out of Both Worlds

The program will be available shortly. Please check back later.

Deep Learning meets Modeling: Taking the Best out of Both Worlds

Presenter: Gitta Kutyniok, Bavarian AI Chair for "Mathematical Foundations of Artificial Intelligence" in the institute of mathematics at the Ludwig Maximilian University of Munich and adjunct professor at Visual Intelligence at UiT

Gitta Kutyniok


Pure model-based approaches are today often insufficient for solving complex inverse problems in medical imaging. At the same time, we witness the tremendous success of data-based methodologies, in particular, deep neural networks for such problems. However, pure deep learning approaches often neglect known and valuable information from the modeling world and are not interpretable.

In this talk, we will develop a conceptual approach by combining the model-based method of sparse regularization by shearlets with the data-driven method of deep learning. Our solvers are guided by a microlocal analysis viewpoint to pay particular attention to the singularity structures of the data. Focussing then on the inverse problem of (limited-angle) computed tomography, we will show that our algorithms significantly outperform previous methodologies, including methods entirely based on deep learning. Finally, we will also briefly touch upon the issue of how to interpret such approaches.

In compliance with GDPR consent requirements, presentations given in a Visual Intelligence context maybe recorded with the consent of the speaker. All recordings are edited to remove all faces, names and voices of other participants. Questions and comments by the audience will hence be removed and will not appear in the recording.  With the freely given consent from the speaker, recorded presentation may be posted on the Visual Intelligence YouTube channel.

This seminar is open for members of the consortium. If you want to participate as a guest please sign up

Sign up here