shift · Sydney
Skills: Python, SQL, CI/CD
Who is Shift? Shift provides business finance to small, established and corporate sized businesses in Australia, including Business Overdraft, Equipment Line, Asset Finance, Term Loan and Trade Account. Founded in 2014, Shift has funded more than 30,000 Australian businesses. At Shift, our unique approach to product innovation combined with our collaborative culture means you can build your career in a supportive environment. You’ll be joining a diverse team of over 300 people who are always looking to deliver better outcomes for Australian businesses. About the role: Want to put your stamp on a data platform? You’ll own our Azure Databricks platform, set its standards and roadmap, and lead the data side of a core lending system migration. You’ll be the senior engineer in a small team, with two junior engineers to develop and plenty of room to shape how data works at Shift. What you’ll do: - Own the data platform roadmap and engineering standards, including CI/CD, separate environments, automated testing, monitoring and access governance through Unity Catalog - Design and lead the build of robust, scalable ELT pipelines on Azure Databricks - Lead the data workstream for our core lending platform migration: remap pipelines and models, and reconcile outputs before and after cutover alongside Engineering - Build and extend a curated, dimensional data model that becomes the default place the business goes for trusted, self-serve data - Lift data quality, freshness and alerting so issues are caught before the business notices them - Keep the platform cost-efficient through cluster optimisation, job orchestration and smart use of compute - Mentor and develop our junior data engineers through code review, pairing and clear standards - Partner with analysts, data scientists, product managers and Engineering to turn business needs into data products people trust What you’ll bring: - 5+ years in data engineering, with deep hands-on experience on Azure Databricks (Spark, Delta…
Sign in to see the original posting
Browse more developer jobs on RoleBurst