Software Engineer, Model Inference (Senior/Staff/Principal)

Core Flow Ai โ€” Australia ยท Posted ~4 days ago

๐Ÿ”“ Log in to save this job, tailor your resume & track your apply process โ€” 7 days free, no card needed.

Log in to add to target list

Description

About us At coreflow, we're redefining entertainment with AI. We're one of the fastest-growing startups globally, serving 20 million users in our first year. We're an in-person company based in Sydney, Australia.We're guided by a set of principles that are foundational to our work and drive every decision:User-first: We build things that people want. We invest time to understand our users and focus on adding value instead of extracting value.High agency, high ownership: We're responsible for the pieces we own, end-to-end. We own every mistake, figure out what went wrong, and fix it. We don't blame anyone or anything else.Urgency: This is a once-in-a-lifetime opportunity. We prioritize well, find ways to increase leverage, and move at an inspirational pace. What you'll do You'll own our model inference stack end-to-end โ€” serving our in-house and open-source models to tens of millions of users at low latency and high throughput, and squeezing every bit of performance out of our GPU fleet. Example projects Ship a high-throughput inference server for our in-house models, serving millions of generations per day at