ph3Project Overview /h3pBased in San Francisco, California. As a Software Engineering Evaluator, you will create cutting‑edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go, while working with cross‑functional teams to enhance enterprise‑level AI‑driven coding solutions. /ph3Responsibilities /h3ulliCurate code examples and solutions for use in AI model training initiatives. /liliEvaluate and refine AI‑generated code to ensure it is efficient, scalable, and reliable. /liliCollaborate with cross‑functional teams to build and improve AI‑driven coding solutions against industry performance benchmarks. /liliBuild agents that verify code quality and identify error patterns. /liliHypothesize and map out the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities on these steps. /liliDesign verification mechanisms that automatically validate solutions to software engineering tasks. /li /ulh3Qualifications /h3ulli3+ years of software engineering experience. /liliStrong expertise in building full‑stack applications and deploying scalable, production‑grade software using modern languages and tools. /liliDeep understanding of software architecture, design, development, debugging, and code quality/review assessment. /liliExperience with Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go. /liliStrong problem‑solving and analytical skills. /li /ulh3Position Details /h3ulliContractor role (no medical or paid leave); potential extensions based on performance and fit. /liliBased in San Francisco, California. /li /ul /p #J-18808-Ljbffr
By continuing you agree to our Terms & Privacy Policy.