CDW · United States
Skills: Python, SQL, CI/CD
Job Summary: ------------
The Software Engineer II, Data builds and supports enterprise data ingestion, transformation, modeling, and integration solutions. This role translates business and source-system requirements into scalable, maintainable data solutions that support analytics, reporting, operational, and downstream application needs.
What you will do: -----------------
Build ingestion and transformation solutions using Microsoft Fabric and Azure Data Factory. Implement pipelines supporting batch, incremental, API, file, database, and event-based integration patterns. Develop reusable and configuration-driven ingestion and transformation patterns where appropriate. Build curated data structures supporting analytics, reporting, operational, and downstream application requirements. Work with structured and semi-structured data, including SQL, CSV, JSON, XML, Parquet, and similar enterprise formats. Work with Azure Data Factory, Azure Data Lake/Storage and Azure SQL/SQL Server. Translate business and source-system requirements into scalable data models. Participate in conceptual, logical, and physical data modeling. Design dimensional and curated models that support enterprise reporting and analytics. Develop complex SQL queries, views, transformations, and data-processing logic. Troubleshoot query, pipeline, and data-processing issues. Perform query and pipeline performance tuning. Identify and resolve data-quality, integrity, completeness, and consistency issues. Perform source-to-target and source-to-source reconciliation. Develop validation checks for new pipelines and changes. Use GitHub for source control and branch-based development. Follow EDAS CI/CD, pull-request, code-review and design-review standards. Use Azure DevOps (ADO) and approved engineering practices to manage delivery. Create maintainable, reusable, well-documented code. Participate actively in peer code and design reviews. Create or improve reusable engineering patterns and suppo …truncated… e…
Sign in to see the original posting
Browse more developer jobs on RoleBurst