Applied AI Engineer, Video Agent
Position Summary & Responsibilities
About HeyGen
At HeyGen, our mission is to make visual storytelling accessible to all. Over the last decade, visual content has become the preferred method of information creation, consumption, and retention. But the ability to create such content, in particular videos, continues to be costly and challenging to scale. Our ambition is to build technology that equips more people with the power to reach, captivate, and inspire audiences.
Learn more at www.heygen.com. Visit our Mission and Culture doc here.
About the Video Agent team
Video Agent turns a prompt, a document, or a handful of assets into a finished video. Behind a simple chat box sits a multi-step AI agent. It plans a storyboard, writes the script, chooses avatars, voices, and visuals, calls many tools along the way, and hands the result to our rendering pipeline. Customers use it every day to make training videos, product explainers, marketing content, and more.
We are a small team that owns the agent end to end. That covers the prompts and tools the agent uses, the backend services that run it, and the product screens where people chat with it and edit what it makes.
This is not a role where you only call someone else’s model through an API. HeyGen trains its own models in house, and the agent is built on top of them. You will work directly with those models and with the researchers who build them, which is an experience few applied AI roles offer.
About the role
You will make Video Agent better at doing what the user actually asked for, and you will prove it with data. Some weeks that means redesigning a tool the agent calls. Other weeks it means building an eval, running an A/B test, or shipping a new editing experience in React. You will own features from the first idea through launch and follow-up, and you will decide which problems belong to the model and which belong to plain, deterministic code.
What you’ll do
- Build the agent. Design the tools, prompts, and context the agent works with. Improve how it plans, how it recovers from mistakes, and how it handles long, multi-turn conversations.
- Measure quality. Build evals and offline replays of real sessions. Run experiments behind fe
Key Role Competencies & Evaluation Highlights
Evaluating extreme execution speed, deep AI/video generative intuition, and an owner-operator mentality with zero ego.
Apply for Applied AI Engineer, Video Agent
Setup your contact terms & referral note to get recommended directly to the hiring lead at Heygen.