buspatrol · India - Hyderabad
Skills: Python, SQL, AWS, CI/CD
Location: Remote Travel: Less than 5% Manages Others: No Education: Bachelor’s Degree in a technical field Experience: 5+ years of relevant experience in data engineering, 5+ years of SQL, 4+ years of Python, 4+ years of experience with schema design and dimensional data modeling The Opportunity The Data Engineer at BusPatrol will be responsible for building and maintaining our data infrastructure to support reporting, analytics, and data science initiatives. The ideal candidate will have strong skills in data architecture, ETL, SQL, and Python within a Git-managed environment, as well as a proven ability to collaborate with both business stakeholders and data team colleagues to deliver robust, scalable data frameworks. This individual will possess strong operational skills to drive efficiency and speed, expertise in building repeatable data engineering processes, strong project management abilities, and a forward-looking vision for delivering impactful data products. The candidate will responsibly leverage AI to accelerate development, maintaining full ownership of all outputs while mastering the codebase to ensure clean architecture and prevent software bloat. Responsibilities: · Create and orchestrate data pipelines within a state-of-the-art AWS environment (Redshift, EC2, EMR/Spark, S3, Lambda, Glue, etc.). · Manage all aspects of the data and analytics ecosystem—from ingestion to ETL to aggregate tables—to meet analytics and reporting needs. · Design and implement internal data pipeline processes and improvements using modern techniques such as automation, optimization, and infrastructure redesign for scalability. · Develop scripts for scheduling data ingestion and synchronization and implement backend logic to create data marts based on business requirements for stakeholder self-service. · Partner with data architects to build frameworks for defining metrics as code and optimizing data search and retrieval. · Troubleshoot production data jobs and processes to…
Sign in to see the original posting
Browse more developer jobs on RoleBurst