Technology Next · Remote, India
Skills: SQL, CI/CD
Experience: 7–8 Years Work Mode: Remote Working Hours: 10:30 AM – 7:30 PM IST Open Positions: 2 Joining: Immediate Joiners Only
Key Skills: LLM | Agentic AI | Test Automation | MCP Integration Testing | RAGAS
Job Description:
We are looking for an experienced Senior Software Engineer – QA with strong expertise in test automation, API testing, and AI testing practices. The ideal candidate should have hands-on experience validating LLM-based applications, Agentic AI workflows, MCP integrations, and RAG evaluation using RAGAS, along with a solid foundation in quality engineering.
Key Responsibilities:
Analyse business requirements, technical specifications, and architecture documents to define comprehensive test strategies. Design and execute test plans, test scenarios, and test cases for functional and non-functional testing. Lead end-to-end testing activities, including functional, regression, integration, system, API, database, and end-to-end testing. Perform AI/LLM application testing, including response accuracy, relevance, hallucination detection, and reliability validation. Test Agentic AI workflows, tool-calling mechanisms, multi-step execution, and agent behaviour. Perform MCP integration testing to validate tool connectivity, communication, data exchange, and error handling. Use RAGAS to evaluate RAG applications, including retrieval quality, faithfulness, and answer relevance. Develop, maintain, and enhance automated test scripts and reusable automation frameworks. Perform API testing using Postman or REST Assured and validate backend integrations. Execute SQL-based database validation to ensure data integrity and consistency. Integrate automated tests into CI/CD pipelines and support continuous testing initiatives. Review test cases and automation scripts, manage defects, and collaborate with development teams for timely resolution. Prepare test execution reports, quality metrics, and release readiness assessments. Mentor junior QA engineers and drive improvemen…
Sign in to see the original posting
Browse more developer jobs on RoleBurst