Responsibilities Design, develop, and refine comprehensive rubrics tailored to AI training and assessment needs. Analyze task performance and provide structured, actionable feedback to guide improvement and calibration. Establish and document effective scoring methodologies that ensure consistency, fairness, and high-quality outcomes. Lead calibration sessions to align evaluators and maintain rubric integrity across projects. Validate assessment outputs for accuracy, reliability, and alignment with project objectives. Oversee quality control processes, making data-driven recommendations for rubric enhancements. Requirements Have proven expertise in rubric design, performance analysis, and feedback structuring for complex assessment environments. Possess a strong background in scoring methodology development and calibration for AI or educational projects. Demonstrate success in assessment validation and quality control processes. Have exceptional written and verbal communication skills, with the ability to convey nuanced judgment and rationale. Have practical, hands‑on grocery shopping experience to inform realistic scenario assessments. #J-18808-Ljbffr
Ai Trainer | $50/Hr Remote
CROSSING HURDLES
Remote, Remote
Published 3 days ago
Report job