Apple · Cupertino, CA, United States
Skills: React, JavaScript, SQL
At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there’s no telling what you could accomplish. Do you want to make Siri and Apple Intelligence features smarter for our users? Contribute to the next revolution in AI and Machine Learning. We're a dynamic team seeking engineers who are enthusiastic about influencing the future of Apple Intelligence.
Description
As a Software Engineer in AIML Evaluation, you will:
Work closely with product managers, backend engineers, data scientists and other stakeholders to improve the overall quality and user experience of numerous Apple products.
Design and develop evaluation system and framework to enhance the quality of Apple Intelligence, ensuring our AI/ML models meet the highest standards.
Tuning evaluation infrastructure, tightening operational controls, improving auditability and debug trails, and scaling the workflows .
You’ll play a pivotal role in developing Apple Intelligence, driving the next generation of groundbreaking products across all Apple platforms.","responsibilities":"Benchmark Design & Development: Design and implement evaluation benchmarks, metrics, and test suites that rigorously measure model capabilities across reasoning, knowledge, code, and agentic workflows.
Product-Aligned Evaluation: Develop evaluation methods that capture how models behave in real product settings, and validate that evaluation metrics predict user-perceived quality and product outcomes.
Evaluation Methodology Research & Tooling: Research and apply state-of-the-art evaluation techniques - including scoring frameworks, model-based judging, and contamination-resistant benchmark design. Build reusable tools, scorer libraries, and analysis frameworks that scale across the team’s benchmark portfolio.
Experimental Analysis: Design and execute rigorous experiments comparing model capabilities, engage with third-pa …truncated… Minimum Qualificatio…
Sign in to see the original posting
Browse more developer jobs on RoleBurst