greenlight-workforce-solutions · United States
We are seeking a highly skilled and detail-oriented Policy & Data Quality Specialist to join our team as a Contingent Worker (Contract). The successful candidate will be responsible for training cutting edge AI models that strictly adhere to policies, for ensuring the quality and accuracy of decisions, creating golden sets, calibrating vendor sites, and managing vendor relationships. This is an excellent opportunity for someone who is passionate about policy analysis and quality assurance to make a meaningful impact on our organization. Experience in content moderation is valuable but not required. This role will involve exposure to potentially objectionable content including but not limited to graphic images, videos and writings, offensive or derogatory language, and other potential objectionable material i.e. child exploitation, graphic violence, animal abuse, self-injury and other content which may be considered offensive or disturbing. KEY RESPONSIBILITIES - Policy & Data Quality Assurance: Review and evaluate decisions made by expert models and vendors to ensure accuracy, consistency, and adherence to policies and guidelines. - Golden Set Creation: Develop and maintain golden sets of content to test and calibrate expert models and vendor performance, ensuring that they meet our quality standards. - Vendor Site Calibration: Collaborate with vendor sites to identify areas for improvement, provide feedback, and implement calibration plans to enhance their performance. - Vendor Management: Build and maintain strong relationships with vendors, providing guidance, support, and performance metrics to ensure they meet our quality expectations. - Process and Policy Improvement: Identify opportunities to improve policies and processes, workflows, and tools, and collaborate with internal stakeholders to implement changes. - Data Analysis: Analyze data and metrics to identify trends, patterns, and insights that inform quality assurance strategies and vendor performance. -…
Sign in to see the original posting
Browse more developer jobs on RoleBurst