Daniel Johansen Trosten defended his PhD thesis “Improving Representation Learning for Deep Clustering and Few-shot Learning” on August 23rd 2023 at UiT The Arctic University of Norway.
Daniel Johansen Trosten defended his PhD thesis “Improving Representation Learning for Deep Clustering and Few-shot Learning” on August 23rd 2023 at UiT The Arctic University of Norway.
Summary of thesis:
The amounts of data in the world have increased dramatically in recent years, and it is quickly becoming infeasible for humans to label all these data. It is therefore crucial that modern machine learning systems can operate with few or no labels.The introduction of deep learning and deep neural networks has led to impressive advancements in several areas of machine learning. These advancements are largely due to the unprecedented ability of deep neural networks to learn powerful representations from a wide range of complex input signals. This ability is especially important when labeled data is limited, as the absence of a strong supervisory signal forces models to rely more on intrinsic properties of the data and its representations.
This thesis focuses on two key concepts in deep learning with few or no labels. First, we aim to improve representation quality in deep clustering - both for single-view and multi-view data. Current models for deep clustering face challenges related to properly representing semantic similarities, which is crucial for the models to discover meaningful clusterings. This is especially challenging with multi-view data, since the information required for successful clustering might be scattered across many views. Second, we focus on few-shot learning, and how geometrical properties of representations influence few-shot classification performance. We find that a large number of recent methods for few-shot learning embed representations on the hypersphere. Hence, we seek to understand what makes the hypersphere a particularly suitable embedding space for few-shot learning.
Evaluation Committee:
- Professor Klaus-Robert Müller, Technical University of Berlin, Germany (1. Opponent)
- Professor Anne H Schistad Solberg, Institute for Informatics, University of Oslo, Norway (2. Opponent)
- Professor Fred Godtliebsen, Department of Mathematics and Statistics (internal member and leader of the committee)
Supervisors:
- Associate Professor Michael Kampffmeyer, Department of Physics and Technology, UiT (main supervisor)
- Professor Robert Jenssen Department of Physics and Technology, UiT (co-supervisor)
- Researcher Sigurd Løkse, Department of Physics and Technology, UiT(co-supervisor)
The Defense was led by Professor John Sigurd Mjøen Svendsen, Pro-Dean at the Faculty of Science and Technology at UiT.
María Castro Fernández is a PhD Candidate at the Research Institute of Applied Microelectronics at Universidad de Las Palmas de Gran Canaria, in Spain. She visited Visual Intelligence in Tromsø from January to June 2024.
AI tools wield enormous potential within the health sector. How do we ensure that such tools are safely implemented and used within this field? The event will take place on August 14th, 11:45-12:45 at Bankgården, Strandgaten 2-4.
Thea Brüsch is a PhD student at the Section for Cognitive Systems at the Technical University of Denmark (DTU). She visited the UiT Machine Learning Group from January to June 2024.
Visual Intelligence happily welcomes Lars Uebbing, who recently started as a doctoral research fellow at Visual Intelligence in Tromsø.
Det tar for lang tid å analysere bilder for å finne ut om en pasient har kreft i leveren. Nå har forskerne laget et system som gjør jobben mer effektivt (Norwegian news story).
We are happy to announce that a Visual Intelligence paper "The 3-billion fossil question: How to automate classification of microfossils" was featured in the scientific newspaper EurekAlert!
In the episode, Østmo was included in an Abels tårn expert panel to answer different questions about AI and deep learning.
Visual Intelligence organized a special curricular course on Generative AI at UiT The Arctic University of Norway this spring. The course covered Large Language Models, Generative AI for images, and Generative AI for audio.
Our sponsorship packages provide a number of benefits, such as registration and networking benefits for company employees, company and brand visibility, and more.
Associate professor and principal investigator Kristoffer Wickstrøm recently talked about a collaborative Visual Intelligence project between UiT and UNN on NRK Radio. The project aims to develop AI algorithms to detect liver cancer on CT images.
We congratulate Tollef Jahren for successfully defending his PhD thesis "Deep learning for detecting valvular events and suppressing reverberations in cardiac ultrasound" for the degree Philosophiae Doctor at Department of Informatics, University of Oslo.
.jpg)
Noen få tastetrykk er alt som skal til for å finne falske nakenbilder og videoer av norske kjendiser. – Ekstremt bekymringsfullt, sier KI-ekspert
Visual Intelligence congratulates Daniel Johansen Trosten for receiving the Dissertation Award of 2023 from Norwegian Artificial Intelligence Society (NAIS)!
Centre director Robert Jenssen represented Visual Intelligence at the marine conference Blått kompass.
The Visual Intelligence Graduate School (VIGS) recently gathered our Tromsø based researchers at Árdna - The Sami Cultural Center for a social event about exchange stays.
We congratulate professor Michael Kampffmeyer for receiving the "Early career investigator" award at the NORA Annual Awards!
Til tross for gode karakterer, søker svært få jenter seg til studier innen matematikk, naturfag og teknologi. En studie viser at det kan handle om lav selvtillit.
We invite submissions presenting new and original research on all aspects of Deep Learning for the Northern Lights Deep Learning Conference (NLDL) 2025.
I am eager to absorb knowledge from these experts and contribute to our collective understanding, says Filippo Bascetta, who is one of two new VI interns.
Listen to VI co-director Line Eikvil and research director Anders Løland (Norsk Regnesentral) talk about developments before and after the breakthrough of deep learning in the NR podcast, Sannsynligvis VIKTIG (Norwegian dialogue).