Limited training data

Visual Intelligence aims to develop new deep learning models that solve problems involving complex images from limited training data.

Motivation

The performance of deep learning methods steadily improves with more training data. However, the availability of suitable training data is often limited. Additionally, labelling complex image data requires domain experts and is both costly and time-consuming.

This research challenge is heavily stressed by a majority of our user partners as an immediate need. To succeed in our innovation areas, it is absolutely necessary to research new methodology which learn from limited and complex training data.

Solving research challenges through new deep learning methodology

Methods which exploit weak, noisy and incompletely labelled data, be it through semi-supervised or semi-supervised approaches, make up a significant portion of our portfolio. Examples include the following:

• A self-supervised approach for content-based image retrieval of CT liver images.

• Explainable marine image analysis methods validated on multiple marine datasets, such as multi-frequency echosounder data and aerial imagery of sea mammals captured by drones.

• A self-supervised method for automatically detecting and classifying microfossils.

• Methods for automatic building change detection in aerial images based on self-supervised learning.

These methods represent time-effective and cost-effective approaches which make deep learning models less reliant on large data samples and labeled data. These improve the models’ efficiency and ability to generalize, making them more applicable in real-world settings.

Highlighted publications

Modular Superpixel Tokenization in Vision Transformers

August 28, 2024
By
Marius Aasan, Odd Kolbjørnsen, Anne Schistad Solberg, Adín Ramirez Rivera

Reinventing Self-Supervised Learning: The Magic of Memory in AI Training

July 29, 2024
By
Thalles Silva, Helio Pedrini, Adı́n Ramı́rez Rivera

Other publications

A Hubness Perspective on Representation Learning for Graph-Based Multi-View Clustering

By authors:

Zheming Xu, He Liu, Congyan Lang, Tao Wang, Yidong Li, Michael Kampffmeyer

Published in:

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025, pp. 15528-15537

on

June 11, 2025

AdaptCMVC: Robust Adaption to Incremental Views in Continual Multi-view Clustering

By authors:

Jing Wang, Songhe Feng, Kristoffer Wickstrøm, Michael Kampffmeyer

Published in:

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10285-10294, 2025

on

June 10, 2025

Interactive Injectite Mapping with Minimal Training Data using Self-Supervised Learning

By authors:

A. Waldeland, T.J.L. Forgaard, A. Ordonez, D. Wade and A.J. Bugge

Published in:

86th EAGE Annual Conference & Exhibition, Jun 2025, Volume 2025, p.1 - 5

on

June 2, 2025

ProxyDR: Deep Hyperspherical Metric Learning with Distance Ratio-Based Formulation

By authors:

Hyeongji Kim, Changkyu Choi, Michael Christian Kampffmeyer, Terje Berge, Pekka Parviainen, Ketil Malde

Published in:

Lecture Notes in Computer Science (LNCS) 2025

on

May 12, 2025

Robust Classification by Coupling Data Mollification with Label Smoothing

By authors:

Markus Heinonen, Ba-Hien Tran, Michael Kampffmeyer, Maurizio Filippone

Published in:

Proceedings of Machine Learning Research (PMLR), Volume 258, pp4960-4968, 2025

on

May 3, 2025