Software Engineer - AI Evaluation Systems

🚀 Software Engineer — RL Environments We're partnering with a fast-growing (Series B) AI company that builds the datasets and evaluation systems frontier AI labs use to train their models. You'd be working hand-in-hand with top research teams designing the tasks models practise on, and the scoring that decides whether they're really getting smarter. What you'd own: 🔹 Design data that exposes where models fail across finance, code & enterprise workflows 🔹 Build reward signals and evaluation rubrics for RLHF / RLVR training pipelines 🔹 Develop frameworks to measure dataset quality and its real impact on model performance 🔹 Turn ambiguous research goals into concrete, shippable systems You must have: 🔹 Strong Python + production ML/data experience 🔹 Hands-on with modern ML/LLM workflows training, fine-tuning or evaluation 🔹 Sharp instincts for data quality, edge cases and precision/recall trade-offs 🔹 1–4 years shipping technical work (RLHF/RLVR or eval experience is a big plus) The details: 📍 San Francisco — on-site, 5 days 💰 starts from $250 base + significant profit share + equity 🛂 Visa sponsorship available (H-1B, O-1, OPT) This is a rare chance to have direct, measurable impact on frontier AI on a small team where your work ships straight into the models defining the field.