Create Alert
Email me similar jobs

Senior Python Engineer — Shape Ai Coding Evaluations

Full-time Datasets QA Realistic AI

Mindrift is building a dataset to evaluate AI coding agents by creating realistic developer environments, tasks, and tests. You design prompts, define success criteria, and ensure solutions are verifiable across multiple valid approaches.

You will iteratively refine tasks based on QA feedback, aiming for fair evaluation of models while managing complexity and realism in simulated environments.

#J-18808-Ljbffr
Similar jobs

Senior Python Engineer — Shape Ai Coding Evaluations

Apply Now
Back to search page