DontApply.Club
Login Register

Senior AI Software Engineer (LLM Evaluation)

Jobsaii — Canada · Posted ~3 hours ago

Senior Full-time Remote

Skills

Python JavaScript ReactJS C/C++ Java Rust Go LLM evaluation and benchmarking Code curation and review AI-generated code evaluation C C++ LLMs AI coding tools

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

A technology client is hiring a Senior AI Software Engineer to focus on LLM evaluation and dataset creation. The role involves curating code examples, building precise solutions, and correcting code across multiple programming languages including Python, JavaScript (with ReactJS), C/C++, Java, Rust, and Go. The engineer will evaluate and refine AI-generated code for efficiency, scalability, and reliability, while collaborating with cross-functional teams to enhance enterprise-level AI-driven coding solutions. Responsibilities also include building agents that verify code quality and identify error patterns. This is a full-time remote position open to candidates worldwide.

Highlights

Fully remote position with work-from-anywhere flexibility. Opportunity to work on cutting-edge LLM training and benchmarking projects. Collaborate with researchers on advancing large language models. Competitive compensation based on experience. Diverse polyglot programming environment across multiple languages.

Description

Role: Senior AI Software Engineer (Remote)Location: Remote (Work from Anywhere)Job Type: Full-TimePayout: Competitive, based on experience Role Overview: We are hiring for one of our clients, seeking a Senior Software Engineer – LLM Evaluation to work on a full-time basis. You will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in multiple programming languages. Key Responsibilities: • Curate code examples, build solutions, and correct code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go. • Evaluate and refine AI-generated code to ensure efficiency, scalability, and reliability. • Collaborate with cross-functional teams to enhance enterprise-level AI-driven coding solutions against industry performance benchmarks. • Build agents that verify code quality and identify error patterns. • Hypothesize on software engineering cycle steps and evaluate model capabilities on them. Required Skills & Qualifications: • Several years of software engineering experience, including 2+ years at a top-tier product company. • Strong expertise in building full-stack applications. • Experience with Python and JavaScript, including ReactJS. • Proficiency in C/C++, Java, Rust, and Go. • Ability to design verification mechanisms for software engineering tasks. More About the Opportunity: This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the advancement of AI systems that drive measurable business impact. Equal Opportunity Employer: We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications. Apply Now!