AI Engineer – AI Observability and Quality
This job is in your area. Enjoy a short commute and work close to home.
Job Description
Overview
About the Role & Team IDC is building the next generation of AI-powered intelligence platforms that transform how technology decisions get made. Our platform re-imagines the way decision‑makers discover and interact with trusted research and data, and is foundational to IDC's future.
We are looking for an AI Engineer – AI Observability and Quality to establish the evaluation function for the platform's AI systems. This is a solo function initially. You will design and build the evaluation infrastructure that ensures the platform produces accurate, well-sourced, high-quality responses. You will be the first hire in this function and must be able to operate independently, defining your own roadmap and building from scratch.
The platform's credibility depends on the quality of its AI-generated intelligence. You will build the automated test suites, regression detection systems, and evaluation frameworks that catch quality issues...