artefactlinkedin · Avenida das Nações Unidas, 12901,11° andar São Paulo
Skills: Python, Java, Docker
Who we are At Artefact LatAm, we believe in and live a culture based on empathy! A healthy work environment is a place where all voices are heard, respected, and valued. Our commitment is to build a more diverse and inclusive environment, because empathy is for everyone, regardless of ethnicity, color, gender, sexual orientation, gender identity, disability, or religious belief. We want incredible minds and hearts to join us! Come be Artefact! What you will be doing: We’re looking for a skilled Data Engineer with hands-on experience in Apache Airflow to join our data team. In this role, you’ll be responsible for designing, building, and maintaining scalable data pipelines and workflows that support our analytics and data-driven products. You act on all the value chain of projects (infrastructures and platforms creation, data collection, application of machine learning models, APIs REST creations, of front-ends, of tests, continuous deployments) You have a good knowledge of python (Java and Scala are an asset), you know how to navigate nix thank to CLI, you are familiar or have already used cloud technologies such as GCP (Google Cloud Platform), you have already used big data technologies like Beam (Dataflow), Spark (Dataproc), or Flink and Docker (GKE is an asset) You can popularize technical terms or solutions to more business oriented profiles, you can work in a team with very diversified profiles You know how to prioritize your tasks, respect deadlines, prevent in case of problems Develop , schedule, and monitor data pipelines using Apache Airflow. Collaborate with data analysts, scientists, and engineering teams to ensure reliable data delivery. Optimize ETL processes for performance, reliability, and scalability. Maintain and improve data architecture, ensuring data integrity and security. Troubleshoot and resolve pipeline failures and performance bottlenecks. Provide technical leadership and guidance in the implementation of technical solutions, ensuring align…
Sign in to see the original posting
Browse more developer jobs on RoleBurst