Every spring, river herring populations migrate from Massachusetts coastal waters to start their annual journey up rivers and streams to freshwater spawning habitat. River herring have confronted extreme inhabitants declines over the previous a number of a long time, and their migration is extensively monitored throughout the area, primarily via conventional visible counting and volunteer-based applications.
Monitoring fish motion and understanding inhabitants dynamics are important for informing conservation efforts and supporting fisheries administration. With the annual herring run getting underway this month, researchers and useful resource managers as soon as once more tackle the problem of counting and estimating the migrating fish inhabitants as precisely as potential.
A staff of researchers from the Woodwell Local weather Analysis Middle, MIT Sea Grant, the MIT Pc Science and Synthetic Intelligence Lab (CSAIL), MIT Lincoln Laboratory, and Intuit explored a brand new monitoring methodology utilizing underwater video and laptop imaginative and prescient to complement citizen science efforts. The researchers — Zhongqi Chen and Linda Deegan from the Woodwell Local weather Analysis Middle, Robert Vincent and Kevin Bennett from MIT Sea Grant, Sara Beery and Timm Haucke from MIT CSAIL, Austin Powell from Intuit, and Lydia Zuehsow from MIT Lincoln Laboratory — revealed a paper describing this work within the journal Distant Sensing in Ecology and Conservation this February.
The open-access paper, “From snapshots to steady estimates: Augmenting citizen science with laptop imaginative and prescient for fish monitoring,” outlines how latest developments in laptop imaginative and prescient and deep studying, from object detection and monitoring to species classification, supply promising real-world options for automating fish counting with improved effectivity and information high quality.
Conventional monitoring strategies are constrained by time, environmental situations, and labor depth. Volunteer visible counts are restricted to transient daytime sampling home windows, lacking nighttime motion and brief migration pulses, when a whole bunch of fish move by throughout the span of some minutes. Whereas applied sciences like passive acoustic monitoring and imaging sonar have superior steady fish monitoring below sure situations, essentially the most promising and low-cost possibility — guide evaluate of underwater video — remains to be labor-intensive and time-consuming. With the rising demand for automated video processing options, this research presents a scalable, cost-effective, and environment friendly deep learning-based system for dependable automated fish monitoring.
The staff constructed an end-to-end pipeline — from in-field underwater cameras to video labeling and mannequin coaching — to realize automated, laptop vision-powered fish counting. Movies had been collected from three rivers in Massachusetts: the Coonamessett River in Falmouth, the Ipswich River (Ipswich), and the Santuit River in Mashpee.
To arrange the coaching dataset, the staff chosen video clips with variations in lighting, water readability, fish species and density, time of day, and season to make sure that the pc imaginative and prescient mannequin would work reliably throughout numerous real-world eventualities. They used an open-source net platform to manually label the movies frame-by-frame with bounding packing containers to trace fish motion. In complete, they labeled 1,435 video clips and annotated 59,850 frames.
The researchers in contrast and validated the pc imaginative and prescient counts with human video evaluations, stream-side visible counts, and information from passive built-in transponder (PIT) tagging. They concluded that fashions skilled on numerous multi-site and multi-year information carried out finest and produced season-long, high-resolution counts in step with historically established estimates. Going one step additional, the system supplied insights into migration conduct, timing, and motion patterns linked to environmental elements. Utilizing video from the 2024 Coonamesset River migration, the system counted 42,510 river herring and revealed that upstream migration peaked at daybreak, whereas downstream migration was largely nocturnal, with fish using darker, quieter durations to keep away from predators.
With this real-world utility, the researchers intention to advance laptop imaginative and prescient in fisheries administration and supply a framework and finest practices for integrating the expertise into conservation efforts for a variety of aquatic species. “MIT Sea Grant has been funding work on this subject for a while now, and this glorious work by Zhongqi Chen and colleagues will advance fisheries monitoring capabilities and enhance fish inhabitants assessments for fisheries managers and conservation teams,” Vincent says. “It would additionally present schooling and coaching for college students, the general public, and citizen science teams in assist of the ecologically and culturally vital river herring populations alongside our coasts.”
Nonetheless, continued conventional monitoring is important for sustaining consistency in long-term datasets till fisheries administration companies totally implement automated counting techniques. Even then, laptop imaginative and prescient and citizen science needs to be seen as complementary. Volunteers will probably be obligatory for digicam upkeep and for contributing on to the pc imaginative and prescient workflow, from video annotation to mannequin verification. The researchers envision that integrating citizen observations and laptop vision-generated information will assist create a extra complete and holistic strategy to environmental monitoring.
This work was funded by MIT Sea Grant, with extra assist supplied by the Northeast Local weather Adaptation Science Middle, an MIT Abdul Latif Jameel Water and Meals Methods seed grant, the AI and Biodiversity Change World Middle (supported by the Nationwide Science Basis and the Pure Sciences and Engineering Analysis Council of Canada), and the MIT Undergraduate Analysis Alternatives Program.
