Image:
Harald Lykke

Well received PhD defense at the Visual Intelligence Research Centre

Daniel Johansen Trosten defended his PhD thesis “Improving Representation Learning for Deep Clustering and Few-shot Learning” on August 23rd 2023 at UiT The Arctic University of Norway.

Well received PhD defense at the Visual Intelligence Research Centre

Daniel Johansen Trosten defended his PhD thesis “Improving Representation Learning for Deep Clustering and Few-shot Learning” on August 23rd 2023 at UiT The Arctic University of Norway.

Summary of thesis:

The amounts of data in the world have increased dramatically in recent years, and it is quickly becoming infeasible for humans to label all these data. It is therefore crucial that modern machine learning systems can operate with few or no labels.The introduction of deep learning and deep neural networks has led to impressive advancements in several areas of machine learning. These advancements are largely due to the unprecedented ability of deep neural networks to learn powerful representations from a wide range of complex input signals. This ability is especially important when labeled data is limited, as the absence of a strong supervisory signal forces models to rely more on intrinsic properties of the data and its representations.

This thesis focuses on two key concepts in deep learning with few or no labels. First, we aim to improve representation quality in deep clustering - both for single-view and multi-view data. Current models for deep clustering face challenges related to properly representing semantic similarities, which is crucial for the models to discover meaningful clusterings. This is especially challenging with multi-view data, since the information required for successful clustering might be scattered across many views. Second, we focus on few-shot learning, and how geometrical properties of representations influence few-shot classification performance. We find that a large number of recent methods for few-shot learning embed representations on the hypersphere. Hence, we seek to understand what makes the hypersphere a particularly suitable embedding space for few-shot learning.

Illustration of how embeddings are embedded on the hypersphere

Evaluation Committee:

- Professor Klaus-Robert Müller, Technical University of Berlin, Germany (1. Opponent)
- Professor Anne H Schistad Solberg, Institute for Informatics, University of Oslo, Norway (2. Opponent)
- Professor Fred Godtliebsen, Department of Mathematics and Statistics (internal member and leader of the committee)

Supervisors:

- Associate Professor Michael Kampffmeyer, Department of Physics and Technology, UiT (main supervisor)
- Professor Robert Jenssen  Department of Physics and Technology, UiT (co-supervisor)
- Researcher Sigurd Løkse, Department of Physics and Technology, UiT(co-supervisor)

The Defense was led by Professor John Sigurd Mjøen Svendsen, Pro-Dean at the Faculty of Science and Technology at UiT.

Daniel Trosten (center) with committee and advisors (Photo: Halald Lykke)

Latest news

New principal investigators at Visual Intelligence

February 15, 2024

Visual Intelligence congratulates associate professors Elisabeth Wetzer, Ali Ramezani-Kebrya, and Kristoffer Wickstrøm with their recently promoted roles as principal investigators at the research centre.

Two Visual Intelligence papers accepted for prestigious AI conference

February 9, 2024

New information theories and divergences by Visual Intelligence have been developed and accepted in the prestigious International Conference on Learning Representations (ICLR) 2024. ICLR has an acceptance rate of approximately 30 percent.

Taught graph machine learning at the Geilo Winter School

February 8, 2024

Associate professor Benjamin Ricaud was one of three invited lecturers at the 24th Geilo Winter School. His presentations focused on graph spectral theory, graph signal processing and their connection to graph machine learning.

TV2: Facebook to tag AI-generated pictures: - Major news

February 8, 2024

In a Norwegian news story by TV2, associate professor Kristoffer Wickstrøm shares his views on Meta's recent statements saying they will tag all AI-generated pictures published on their platforms.

TV2: Experts warn: - Makes you a felon

February 5, 2024

In a news story by TV2, associate professor Elisabeth Wetzer at UiT Machine Learning Group addresses the accessibility of deepfake tools and the necessity of proper AI legislation to combat the production and spread of such materials.

Visual Intelligence represented at Arctic Frontiers 2024

January 30, 2024

Visual Intelligence (VI) director Robert Jenssen represented the research centre during the Arctic Frontiers panel discussion, "Tilpasning til fremtidens næringsliv: kunnskap og kunstig intelligens".

Meet Petter, our new science communicator

January 26, 2024

His core work tasks involve communicating research activity from Visual Intelligence and UiT Machine Learning Group, as well as being a facilitative resource for science communication. - I am very excited to get acquainted with our researchers and their projects, says Bjørklund.

Thank you for participating in NLDL 2024!

January 16, 2024

Thank you to our participants who traveled to Tromsø to attend this year’s Northern Lights Deep Learning Conference (NLDL) from the 9th to 11th of January!

Pratet om kunstig intelligens og NLDL-konferansen på NRK Radio

January 5, 2024

I morgen tidlig kunne du høre senterleder for Visual Intelligence, Robert Jenssen prate om kunstig intelligens og NLDL-konferansen på NRKs radiosending. Hør hele NRK-intervjuet med Jenssen her (tidsstempel 01:30:00):

Kunstig intelligens: Advarer mot diskriminering av minoriteter

December 19, 2023

Helsevesenet er om bord når KI-toget nå forlater stasjonen. Men kan vi stole på at kunstig intelligens driver likebehandling av pasienter? – Det finnes en risiko for diskriminering, og minoritetsgrupper er særlig utsatt, advarer Mathias Karlsen Hauglid.

Change of Chair of the Visual intelligence Board

December 11, 2023

Gudmundur Jøkulsson, Kongsberg Satellite Services succeeds Anita Schumacher, CEO University Hospital of North Norway as chair of the Visual intelligence Board from 2024.

Visit from The Computer Vision Lab, University of Victoria, Canada

November 25, 2023

The Visual Intelligence group at NR recently had a visit by from Mélissa Côté, Research Associate at the Computer Vision Lab to discuss deep learning and marine acoustic data.

Ja takk til «krysskulturelle» prosjekter drevet fram av teknologiutvikling

November 21, 2023

Forskningsrådet står ovenfor en krevende oppgave med å blidgjøre et stort og aktivt KI-miljø i Norge. Vi håper at eksemplene på vellykket samarbeid mellom humanister og teknologer kan være til inspirasjon i prosessen