Agreement with official human counts
Raw model output before QA correction
Back to Ark CVField validation 01Wells Dam · Washington
A four-season evaluation of automated fish passage monitoring under real operational conditions at Wells Dam.
Agreement with official human counts across 32,087 sockeye.
Raw model output · before QA correctionRaw model output before QA correction
Across 40 peak-migration hours
Winter through fall conditions
Answer in brief
At Wells Dam, Ark CV compared raw, pre-QA model counts with official human counts across three independent high-volume video windows totaling 40 hours and 32,087 sockeye observations. The resulting 98.7% agreement applies to those specific video periods. It is not a universal accuracy rate for other sites, species, seasons, or acoustic-imaging systems, which require their own validation.
Why this work matters
Salmon are the backbone of the Pacific Northwest ecology—and the counts behind fisheries decisions need to be dependable.
Salmon support tribal and recreational fisheries, commercial harvest, and necessary ecosystem function in both marine and freshwater life history phases. For decades, fish managers and hydroelectric dam operators have dedicated thousands of hours to monitoring and enumerating salmon returns.
This critical data supports our understanding of run strength, population-level success, ESA listing status, and informs fishery openings and closures.
Until very recently, human counters performed this important enumeration work. Computer vision can now modernize the process—alleviating the need for continuous manual counting, adding data not easily obtained by people, and reducing the cost of arduous human review.
Ark CV has been evaluated using real operational footage across winter, spring, peak summer migration, and fall conditions to determine whether automated monitoring can perform reliably through the year.
The study
Ark CV partnered with Natural Resources staff at Douglas PUD in East Wenatchee, Washington. Tens of thousands of salmon pass two adult salmon fish ladders and viewing windows at Wells Dam annually.
Recorded video from Douglas PUD was ingested into Ark CV’s computer vision model. Tests were performed blindly, without knowledge of the manual counts reported during each video period. Results were compared only after the model’s initial effort was complete.
Passage direction, species, fish length, and adipose-fin presence—multiple reviewable data points for every detection.
I think we were a little suspicious that computer vision would struggle to resolve edge cases that human fish counters can. Fish passage isn’t one-directional, and fish can obscure each other. After development and tweaks during the test period, I think we have arrived at a place where the model is capable of enumerating fish, identifying species, fish size, and adipose presence at a higher accuracy rate than human counters.
Andrew GingerichNatural Resources Supervisor · Douglas County Public Utility District
Seasonal results
Each season presents a different monitoring challenge—from long quiet periods to dense migrations and changing fish morphology.
Low volume · variable conditions
Performance remained stable in winter conditions. Across five winter validation days totaling 25 steelhead observations, Ark CV achieved 100% species agreement (25/25 correctly identified as steelhead) and 96% adipose agreement (24/25 correct adipose classifications).
Importantly, these results were drawn from 76 hours of reviewed footage spanning January through mid-April. Although overall winter fish volumes were low, the system was evaluated across a substantial amount of video under variable lighting and environmental conditions. Importantly, the model can quickly remove long periods (hours and days) of lack of activity, when fish are not passing through the field of view.
This footage is otherwise reviewed by human counters at 8–16× speed, presenting an opportunity for error by human counters who are trying to quickly digest slow periods of fish migration.
Early-run detection · focused QA
Ark CV demonstrated sensitivity to early-run fish. In a May validation window encompassing 31 hours of footage, the system identified an early-arriving sockeye prior to the first official seasonal report on June 11 by human counters.
Subsequent blind video review—reviewers were unaware of both the model prediction and official human count—confirmed the detection, illustrating the system’s ability to detect out-of-pattern fish without relying on seasonal assumptions and biases cast by human counters who are not expecting a given species during an unlikely seasonal period.
A core component of Ark CV’s architecture is its confidence-based QA workflow. Every detection receives a confidence score. Low-confidence detections are automatically flagged for short review clips. This allows human reviewers to focus exclusively on edge cases rather than manually reviewing hours of footage. Computer vision counts assigned high confidence scores—the majority of cases—are automatically tallied into the database results without the need for review.
During the May Chinook validation window, 197 of 209 fish were identified automatically at high confidence (94.3%). Twelve detections (5.7%) were flagged for QA review. Total review time was under five minutes, and all twelve were confirmed as valid detections through blind review. Final species agreement for that time window reached 100%, while adipose classification agreement was 98.1% (205/209).
This workflow transforms what would traditionally require hours of manual review into a focused review of only a small fraction of detections that warrant additional scrutiny.
Peak migration · high density
During peak migration in July 2024, Ark CV was evaluated in three independent high-volume validation time windows totaling 40 peak hours and 32,087 sockeye observations. Because the 2025 Columbia River sockeye run was significantly lower than the 2024 run, archived 2024 video was used to pressure-test the model under high-density conditions.
Using raw model outputs prior to any QA correction, the system achieved 98.7% agreement with official human counts. These video clips included passage periods with sustained passage rates exceeding 1,000 fish per hour. Agreement remained consistent across all three periods, ranging from 98.2% to 98.9%, with no evidence of instability at high fish densities. The model showed no systematic overcount bias and maintained consistent performance across ladders and time windows.
Multiple species · changing morphology
Seasonal robustness continued into the fall, when fish coloration and morphology changed during upstream migration as many fish species transitioned into spawning condition.
Across two late-September validation periods—September 28 and September 30—Ark CV was evaluated on a combined multi-species dataset that included Chinook, Coho, and steelhead. This window had 53 combined Chinook and Coho observations, and species agreement reached 98.1% (52/53 correct), with a single cross-species misclassification and no missed detections.
Adipose classification also remained strong across the combined dataset. Steelhead adipose agreement was 95.4% (104/109), while Chinook adipose classification achieved 100% agreement (36/36).
While fall sample sizes remain smaller than peak summer migration volumes, these results indicate stable multi-species performance as fish appearance evolves throughout the season.
Conclusion
These validation periods demonstrate that Ark CV maintains high agreement across species, seasons, and migration intensity, with a workflow designed for real-world deployment rather than laboratory conditions.
Fall and winter samples were smaller than the peak summer dataset. Results should be read in the context of the reported species, time windows, and sample sizes.
Your footage. Your conditions.
Share representative footage and the monitoring questions your team needs answered. We’ll outline a practical, site-specific validation path.
Request a feasibility assessment ↗