blackcanyonconsulting · Bethesda, MD
Skills: Python, SQL, AWS
Overview We are seeking a Data Architect to lead the data architecture for a federal modernization initiative supporting permitting and natural resource management systems. The Data Architect will define and guide implementation of a modern AWS lakehouse that consolidates structured, document, geospatial, and event-driven data from multiple source systems into a governed canonical model. The role will establish architectural patterns for metadata-driven and agentic data engineering, data quality, document processing, GIS integration, and governed data products. The environment includes Amazon S3, Apache Iceberg, AWS Glue Catalog, DuckDB, Kafka/Amazon MSK, OpenSearch, GeoParquet, and PostGIS. This position is remote with periodic travel as required. Duties & Responsibilities Serve as the primary architecture authority for the data workstream. Define the end-to-end data architecture spanning ingestion, bronze/silver/gold processing, document pipelines, GIS processing, analytical data products, and downstream services. Design the lakehouse architecture using Amazon S3, Apache Iceberg, AWS Glue Catalog, and DuckDB. Define reusable patterns for batch, API, file, database, CDC, and event-driven ingestion. Establish a metadata-driven architecture that supports configuration-based source onboarding and source-to-canonical mappings. Define and govern the common canonical data model used to harmonize information across source systems. Establish data contracts and standards for lineage, provenance, reconciliation, schema evolution, auditability, and data quality. Define architecture patterns for agentic solutions supporting source analysis, mapping, pipeline generation, testing, reconciliation, and quality assurance. Establish controls for agentic workflows, including validation, observability, security, deterministic execution, and human review where required. Coordinate architecture across structured data, OCR/document processing, vector search, and geospatial data. Provide…
Sign in to see the original posting
Browse more developer jobs on RoleBurst