AI Quality Analyst Job at Virtual Vocations Inc, United States

NmVnaTdaeDZWcWpUTCtvdHVCVjJOalRLdVE9PQ==
  • Virtual Vocations Inc
  • United States

Job Description

Partnering with clients during implementation, the full-time AI Quality Analyst will assess the quality and safety of AI-generated responses, translating client requirements into evaluation frameworks while working remotely. Key responsibilities Review and score AI responses using standard rubrics and validate against sources to identify risks Translate client requirements into evaluation criteria and test coverage, acting as a quality liaison between clients and technical teams Document findings and collaborate with peers to ensure consistent scoring and address quality issues proactively Required qualifications Experience in AI evaluation, data annotation, or quality assurance in a regulated environment Familiarity with large language models and their common failure modes Strong analytical judgment with the ability to apply detailed guidelines consistently Experience in client-facing roles such as implementation or consulting in a SaaS environment Ability to translate business needs into technical evaluation criteria

Job Tags

Full time

Similar Jobs

Deaconess

PRN Patient Safety Attendant - Resource Team (PSA) - No Experience Required Job at Deaconess

 ...Midtown units in Evansville, IN, Gateway units in Newburgh, IN, and our Henderson Campus in Henderson, KY campus as needed. Patient Safety Attendants provide supervision of critical care patients as delegated by a registered nurse and in cooperation with other team... 

HIKE2

Salesforce Consultants Job at HIKE2

 ...looking for talented individuals to join our team! As a seasoned Salesforce professional we'd love to hear from you. Job Description...  ...more. Don't meet every requirement? As an innovation consultancy, we recognize that talent is not always related to job... 

BayNova LLC

Quality Assurance Specialist Job at BayNova LLC

 ...Quality Assurance Analyst BayNova has an exciting opportunity for a Quality Assurance Analyst to join our team in support of an important federal government client, in a fully remote / work from home role. This role performs functional and integration testing. The... 

vanshomecenter.com

Flooring Installer Job at vanshomecenter.com

 ...Flooring Installer Van's Home Center is looking for a talented Flooring Installer to join our team, including carpet, hardwood, vinyl, and tile installers. As a Flooring Installer, you are a key member of the team responsible for the quality and efficient installation... 

The GEO Group Australia Pty Ltd.

HR & Onboarding Specialist Job at The GEO Group Australia Pty Ltd.

 ...employee relations, and benefits administration. The ideal candidate has a high school diploma or equivalent with at least three years of HR experience, excellent communication, and organizational skills. Responsibilities include maintaining employee records, ensuring...