Sara Vanaki shares advice for future scholars and describes her project using computer vision to identify creatures in sea floor photos.
NOAA has collected millions of images of the seafloor to learn about the organisms that live there. But how do you look at millions of photos and identify what is in them? Sara Vanaki, a 2021 Hollings scholar, spent her summer internship with NOAA Fisheries taking on this challenge. She created a machine learning program that can analyze the images and identify sand dollars and sea stars.
These images showcase the improvement in Sara’s machine learning program. The image on the left is from her team’s first time running the program. The squares indicate an identified sand dollar and the number next to the square indicates how confident it is in the identification. After going through several hundred such images and checking machine annotations, they were able to improve the machine learning program. The image on the right shows how accurate the machine was after improvements. (Image credit: Sara Vanaki)