For decades, working with spatial and Earth observation data meant standing up heavy database servers, managing complex tile caches, and paying steep licensing taxes. Today, spatial data infrastructure has been quietly reinvented around HTTP range requests, columnar storage (GeoParquet), STAC/Portolan catalogs, Cloud Optimized GeoTIFFs (COGs), and ephemeral in-process compute engines like DuckDB.
I am expanding my viral architecture essays into a comprehensive practitioner handbook—and sending out a curated Weekly Spatial, DuckDB & AI Intelligence Briefing featuring the top 5 community essays, news developments, and Google Research papers.
1x weekly curated intelligence • Zero fluff • Unsubscribe anytime.
How engineering teams replace monolithic GIS servers and expensive cloud warehouse queries with open standards on object storage.
| Architectural Layer | Legacy / Server-Centric GIS | Cloud-Native Geospatial Stack | Primary Engineering Benefit |
|---|---|---|---|
| Vector Storage | Shapefiles, GeoJSON, File Geodatabases | GeoParquet / FlatGeobuf / Iceberg | Columnar compression, spatial bounding-box predicate pushdown over S3/HTTP. |
| Raster & Earth Observation | Monolithic GeoTIFFs, proprietary mosaic servers | Cloud Optimized GeoTIFF (COG) / Zarr | Stream only the pixels and overviews needed via HTTP byte-range requests. |
| Discovery & Metadata Catalogs | Heavy CSW portals, siloed SQL catalogs | STAC & Portolan | Static, crawlable JSON/Parquet catalogs that unify discovery and data distribution. |
| In-Process / Serverless Spatial SQL | Always-on PostGIS instances or high-cost Cloud Warehouses | DuckDB Spatial & DuckDB-WASM | Ephemeral compute: spin up in milliseconds in Python, CLI, or browser; zero idle cost. |
| Distributed Cluster Compute | Custom multi-machine GIS server clusters | Apache Sedona (Spark / Rust) | Petabyte-scale spatial joins and satellite raster algebra across cloud lakes. |
| Web Map Tile Delivery | GeoServer / MapServer / TileServer VMs | PMTiles + MapLibre GL | Single-archive vector/raster tiles hosted on S3/Cloudflare CDN with zero tile servers. |
| AI & Semantic Reasoning | Unstructured vector RAG without spatial topology | Spatial Ontologies + GraphRAG + Earth AI | Deterministic topological grounding that prevents LLM hallucinations in high-stakes decisions. |
Deep dives into DuckDB framing, Portolan, Spatial SQL, Apache Sedona, Earth AI, and GraphRAG.
When people think about climate science and AI, they usually think about prediction. Forecasting temperatures decades into the future. Estimating sea level rise. Identifying regions at risk from drought, wildfire, or...
Read Architecture Note →The conversation around corporate data has never been louder. Executives routinely describe information as their most valuable asset, and boardrooms are packed with leaders eager to become "data-driven." Meanwhile, AI...
Read Architecture Note →My friend Bill Dollins recently published an excellent piece on neuro-symbolic AI and the geospatial workload over at his geoMusings blog. He unpacks where purely neural approaches fall short and how symbolic logic can...
Read Architecture Note →Google Research just dropped an interesting technical report on their Earth AI initiatives, specifically focusing on how they're using "Geospatial Reasoning agents" to tackle massive planetary challenges. You can read...
Read Architecture Note →For years, anyone who worked with geospatial data learned to live with a certain amount of pain. Publishing a dataset meant standing up servers, maintaining databases, babysitting APIs, and hoping the whole thing held...
Read Architecture Note →The DuckDB team recently highlighted a post by Nikolas Göbel on DuckDB, and it’s one of those ideas that sticks because it quietly rewrites how we think about data systems. For years, databases were the place where data...
Read Architecture Note →There is a growing realization in the AI engineering world that vector search is hitting a ceiling. It still works well for fuzzy matching and broad semantic retrieval, but it struggles when the task requires actual...
Read Architecture Note →Matt Forrest shared a story that struck a chord with me. He talked about winning an atlas in a third grade contest and not realizing that it could become a career. He didn't know geography was even a department until an...
Read Architecture Note →The recent conversation around America.gov highlights something that has been building for years. Something I've been trying to raise awareness of for years. People want government information that is clear,...
Read Architecture Note →