AI Quality Analyst Job at Virtual Vocations Inc, United States

NmVnaTdaeDZWcWpUTCtvdHVCVjJOalRLdVE9PQ==
  • Virtual Vocations Inc
  • United States

Job Description

Partnering with clients during implementation, the full-time AI Quality Analyst will assess the quality and safety of AI-generated responses, translating client requirements into evaluation frameworks while working remotely. Key responsibilities Review and score AI responses using standard rubrics and validate against sources to identify risks Translate client requirements into evaluation criteria and test coverage, acting as a quality liaison between clients and technical teams Document findings and collaborate with peers to ensure consistent scoring and address quality issues proactively Required qualifications Experience in AI evaluation, data annotation, or quality assurance in a regulated environment Familiarity with large language models and their common failure modes Strong analytical judgment with the ability to apply detailed guidelines consistently Experience in client-facing roles such as implementation or consulting in a SaaS environment Ability to translate business needs into technical evaluation criteria

Job Tags

Full time

Similar Jobs

Virtual Vocations Inc

Certified Medical Interpreter Manager Job at Virtual Vocations Inc

 ...or equivalent education and experience4+ years of experience in a healthcare setting with direct patient contactCertification as a Translator or Medical InterpreterExperience in Spanish, Russian, Arabic, or Bengali preferredSupervisory experience is preferred... 

Actalentservices

Lab Technician Job at Actalentservices

 ...workspaces, managing lab inventory, and performing basic data entry related to samples and experiments. Essential Skills Bachelor's degree in Biological Sciences, Molecular Biology, or a closely related biological discipline. At least 1 year of experience working in a... 

Mohawk Industries Inc

Training Coordinator Job at Mohawk Industries Inc

 ...building relationships and initiatives to extend employee tenure and engagement, event planning and coordination, coordinating and tracking new employee MPACT training, tracking and other related duties as assigned.What youll do:Manages all onboarding processes included... 

LCA Lab. Corp. of America

Phlebotomist Job at LCA Lab. Corp. of America

 ...diagnostic testing and drug development solutions, is seeking a Phlebotomist to work at the Lakewood Patient Service Center (11750 W. 2nd...  ...completion of an accredited training program, or 3 months experience as a Phlebotomist.Additional Job Standards Phlebotomy certification... 

Carle Health

RN - Outpatient Dialysis Center Job at Carle Health

 ...Licensed Registered Professional Nurse (RN) - Illinois Department of Financial and Professional...  ..., Work Experience:ResponsibilitiesCLINICAL EXCELLENCE FOCUS: Promotes the use of...  ...procedures with the focus being on outpatient dialysis: in-center hemodialysis, knowledge...