From Shutdown Risk to a Stronger National Service
Here's where I celebrate one of my team's recent successes:
The Water Quality Portal is easy to take for granted. You search, download data, and move on with your work. Behind that straightforward experience sits a national resource containing more than 440 million water-quality records from over 1,700 data providers and 2 million monitoring locations. Some of the data goes all the way back to the 1940s. Researchers, government agencies, application developers, and the public rely on it every day.

Earlier this year, its future wasn’t guaranteed.
At USGS, aging infrastructure, deteriorating data flows, reduced staffing, and a hard September 30 fiscal year deadline created a real risk to the Portal’s continued operation. EPA's Office of Water stepped in to take ownership without interrupting public access, losing data, breaking existing URLs, or disrupting the applications built on its services.
A deadline that focused the work
EPA’s Office of Water asked OCIO and my team to help in the spring. What followed was an intense, three-month effort involving a small but focused team of EPA, USGS, contractors, security, network, web and program staff, and others.
The job called for more than moving servers. We had to understand a complex inherited system, stand up a new cloud infrastructure, recover and validate data, rebuild operational processes, test real-world integrations, coordinate security and DNS changes, and prepare EPA to operate the service for the long term.
On September 8, the team completed the public cutover. That was more than three weeks ahead of the deadline. The Water Quality Portal remained available, its familiar URL continued to work, and operational ownership moved successfully to EPA.
That alone would’ve been worth celebrating. The team accomplished considerably more.
Modernization happened during the move
The migration gave us an opportunity to improve the service rather than reproduce its existing limitations.
The team deployed the Portal’s user interface, APIs, and supporting services using containerized cloud infrastructure. Terraform made the environment repeatable. Managed PostgreSQL provided the data foundation, while Step Functions, Glue, and Database Migration Service helped create a more automated data pipeline. CloudWatch dashboards, alerts, cost tracking, load testing, and web application firewall protections gave operators much better visibility and control.
One of the most meaningful improvements was the data refresh process. A workflow that had taken roughly two days now completes in about two hours, leveraging AWS services like DMS and Glue.
Migration work also exposed problems that couldn’t simply be carried forward. The team repaired broken map layers, corrected missing navigation options, updated stale API references, addressed accessibility findings, removed unsupported behavior, and documented obsolete components. On-the-fly security remediation addressed almost 600 critical and high vulnerability findings.
By late September, the team had completed 313 distinct Jira work items while still delivering ahead of schedule and under budget.
Partnership made the difference
This outcome belongs to a broad group of people who shared a clear mission.
EPA’s Office of Water brought program knowledge, requirements, and product ownership. USGS provided essential expertise, artifacts, testing, and knowledge transfer. OCIO and the DMAP Fusion Team coordinated architecture, engineering, security, governance, infrastructure, testing, and the final transition. Contractor partners turned plans into working systems, often under tight time constraints.
The project worked because it never became a simple handoff between organizations. People stayed engaged, surfaced risks early, tested together, and kept public continuity at the center of each decision.
USGS has published its own perspective in WQP modernization: Evolving the nation’s water-quality data infrastructure. It’s a valuable companion to this story and reflects the collaborative work required to sustain a resource of this scale.
From rescue to resilience
I’m proud of what this team accomplished.
We preserved access to an irreplaceable national data resource, improved its security and accessibility, automated critical operations, and gave EPA a stronger foundation for its continued stewardship. The experience also produced a practical model for future transitions involving distressed or aging public systems.

Most visitors to the Water Quality Portal won’t see the architecture, deployment pipelines, monitoring, security controls, or interagency coordination behind it. That’s fine. They’ll see a dependable public service that continues to provide open access to water-quality data.
That’s the result that matters, and it’s one worth celebrating.
For more information, visit the Water Quality Portal, review its web services documentation, learn about EPA’s Water Quality Exchange, or explore the data through How’s My Waterway.
Author: David G. Smith • Source: https://davidgsmith.net/thoughts/from-shutdown-risk-to-a-stronger-national-service.html
Related Thoughts
Perspectives sharing related architectures, models, and domain context.
When a Database Stops Being About Data
The DuckDB team recently highlighted a post by Nikolas Göbel on DuckDB, and it’s one of those ideas that sticks because...
Data Governance: The Strategic Asset Most Organizations Treat as an Afterthought
The conversation around corporate data has never been louder. Executives routinely describe information as their most...
You're Not Too Old For This
In just the last few weeks, I've heard more than a handful of people say some version of the same thing. "I don't know...