lawzero · Berlin; Montreal
Skills: Docker
We are seeking a visionary and highly technical Senior Data Platform Engineer to architect, implement, scale, and maintain the data engine powering our next-generation frontier models. In this high-impact role, you will bridge the gap between cutting-edge AI research and high-performance engineering, treating the data platform as an internal product with our researchers as your primary customers. You will be responsible for building automated, petabyte-scale data processing pipelines and for guaranteeing that everything they produce is efficient, reliable, and fully traceable. Our technical environment is not fixed and will evolve as our projects scale. We expect someone capable of evolving it, not only following industry trends, challenging it, and making sustainable decisions in close collaboration with our Research and Product teams. The title of Engineer is used for reference purposes and may or may not be the official title of the applicant based on jurisdiction. Key Responsibilities Scale and automate the data processing stack to handle petabytes of data and ensure its smooth operation. Design the execution layer for pipeline stages of differing computational shape, matching each stage to an appropriate engine and keeping the pipeline saturated end to end. Ensure efficient use of compute resources, including GPU access for compute-intensive data processing tasks. Make pipelines reliable at scale, with graceful failure recovery, restartability, and observability that attributes bottlenecks and cost to the responsible stage. Ensure all datasets, including the intermediate outputs of each transformation stage, are versioned, reproducible, and fully traceable to meet specific and dynamic experiment needs, and are accompan …truncated… t; About LawZero LawZero is a non-profit organization committed to advancing research and creating technical solutions that enable safe-by-design AI systems. Its scientific direction is based on new research and methods proposed by Pr…
Sign in to see the original posting
Browse more developer jobs on RoleBurst