Prompt Engineer

Apptad — Canada · Posted ~2 hours ago

Mid Full-time

Skills

Python prompt engineering LLM evaluation performance testing prompt benchmarking AI/ML OpenAI models LLM monitoring OpenAI LLMs Generative AI Machine Learning

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

Join a machine learning team focused on building AI and generative AI solutions. You will combine Python development with prompt engineering, translate business requirements into effective prompts and code, work with multiple large language models, and continuously test, benchmark, monitor, and optimize model performance. The role also includes contributing to reusable Python libraries and supporting their ongoing maintenance.

Highlights

Work within a machine learning team on AI and generative AI solutions, collaborate with business stakeholders, develop and maintain Python tooling, and perform structured prompt testing, benchmarking, and performance analysis.

Description

Job Title: Prompt Engineer Location: Montreal, QC Qualifications Primary Responsibilities The developer will be working within a machine learning team/squad. The team is working on developing Artificial Intelligence solutions including ML and Gen AI. The candidate should be familiar with python development and prompt engineering. The candidate should be able to work with different Clients/SME’s and understand the business requirements for prompt engineering and proper python code development. Experience with Open AI and different LLM models, conduct testing and performance evaluation is required. Good candidate should be familiar with ongoing monitoring. · Contribute to development and maintenance of the python library. · Contribute to the support of the library. · Participate in prompt engineering. · Maintain the prompts and keep them up to date with the new LLM versions · Conduct regular testing and performance analysis. · Participate in prompt benchmarking experiments. Skills Required - Excellent prompt engineering skills - Bachelor’s in computer science or related field - Years of experience: 5+ - Hands-on experience in building python applications - Excellent Python development skills - Experience of Agile development - Strong analytical skills and passion for problem-solving - Good communication skills Skills Desired - Experience with machine learning, vector databases - Cloud-based application development preferably using Microsoft Azure Cloud - Prior experience in FinTech application development - Exposure to working in a global delivery team