An early attempt to identify seals from aerial images of the sea ice.

Image:

Detection of sea mammals from aerial imagery

Efficient and reliable methods for automatic analysis of complex marine observation data are needed to ensure sustainable fisheries and harvest. The Institute for Marine Research (IMR) has a mission to be a leader in providing knowledge to ensure sustainable management of resources in our marine ecosystems.

Abundance estimation of sea mammals like ice breeding seals (harp and hooded) and coastal seals (grey and harbour) are based on aerial photographic surveys. The Institute of Marine Research (IMR) utilizes aerial images of the sea ice captured from above as a data source to estimate abundance of seal populations.

An aerial image cropped down to an identified seal pup.

To achieve this in a reliable and cost-effective manner better automation of this process is needed and will lead to better long-term management of seal populations. Previous activities have demonstrated that there is a potential in using deep learning for this. However, limitations in training data due to incomplete annotations and shifts in sensors and conditions over time are challenges that need to be solved.

For the detection and classification of seals on ice, the datasets will come from both drones and manned aerial surveys. We will start from previous models and extend these to include more species (coastal seal species). Furthermore, we need to improve on these models to better handle incomplete annotations and shifts in sensors and conditions over time, with the aim of limiting false positives, and to account for large fractions of images without seals.

Video

Further reading

Performing objective measurements in ultrasound images
March 8, 2021
Exploiting limited data to perform objective measurements in ultrasound images of the heart.
Opening the black box of AI
January 19, 2021
Deep learning and AI models must become interpretable, explainable and reliable before they can be utilized in complex domains.
Detection and classification of fish species from acoustic data
March 1, 2021
We collaborate with the Institute of Marine Research (IMR) to develop models and applications to detect and classify fish from echosounders.