Context and dependencies

Background

The strength of machine learning methods is the ability to learn from data rather than using predefined models. For complex data there is however a need to integrate the best of these two worlds to enable integration of physical or geometrical models, dependencies, and prior knowledge, as well as the exploitation of multiple complex image modalities simultaneously.

Challenges

Current deep learning systems for image analysis depend on individual pixel information, capturing dependencies solely via the convolution neighborhood.

This means that the ability to incorporate context and prior knowledge, e.g. about topology or boundaries, is limited. The ability to conform to physical models, and principles governing the image data generation and its properties is also limited, including modelling of temporal dependencies and processes. In order to make deep learning based computer vision systems ubiquitous and applicable also for complex, sparsely labelled image data, there is a need for visual intelligence that can easily be adapted to new, non-standard data sources with few labelled training samples.

Main objective

To develop new methodology to exploiting context, dependencies and prior knowledge in deep learning.

Highlighted publications

On the Effects of Self-supervision and Contrastive Alignment in Deep Multi-view Clustering
December 19, 2023
We propose DeepMVC – a unified framework which includes many recent methods as instances.
Merging clustering into deep supervised neural network
June 8, 2023
Introducing the SuperCM technique to significantly improve classification results across various types of image data.
Addressing Distribution Shifts in Federated Learning for Enhanced Generalization Performance
June 4, 2023
Training and test data from different clients pose a challenge.