Agent Architect
Pencil, LATAM - Argentina
- Pay
- Not listed by the employer
- Work type
- Remote
- Level
- Not stated
- Area
- Software engineering
- Posted
- Aug 5, 2026
Check my fit
See how your résumé lines up with this role: where you match, what's missing, and lines worth rewording.
About the role
ABOUT US
Pencil uses generative AI to make advertising faster, cheaper and better performing, without replacing the creative people who make it. We are building the agentic operating system for marketing: Scribble, our agent, takes a brief and produces finished, brand-safe creative across image, video and structured formats for global brands and small businesses alike.
THE ROLE
Agent Architects take a client's creative problem and make Scribble solve it reliably. You will lead discovery with brand and agency teams, define with them what a correct output looks like, and improve Scribble's performance against that definition until the work is ready to ship. You will then work out which parts of that solution should become standard behaviour in the core product for every customer.
This is a consulting role. You will shape agent behaviour through Pencil skills, evaluation criteria and a structured optimisation process, and you will build small helper projects, such as scripts, prototypes or data preparation tools, where they speed up the work. Where a client problem needs a change to the platform itself, you will make the case to the core product squads with evidence from your engagements.
You will report to the Head of Agent Architecture and be deployed into client teams as engagements require.
HOW WE WORK
Our optimisation practice rests on a few principles. We start from the client's real briefs and agree what good looks like in terms precise enough to measure. We measure performance before changing anything, so every improvement can be shown against a baseline. We change one thing at a time and keep a record of what changed and why. We treat a failure as something to diagnose before fixing, because the cause may sit in the inputs, the agent's instructions or the way we are measuring. We call the work done only when results hold up on repeat. Much of the mechanical work is carried out by AI agents that you direct, so your time goes on judgement, diagnosis and the client relationship.
KEY RESPONSIBILITIES
- Client discovery: Run structured discovery sessions with brand and agency stakeholders, and turn ambiguous briefs into a scoped problem with an agreed, measurable definition of done.
- Optimising for clients: Lead the optimisation of Scribble for your engagements from baseline to confirmed result, and give clients clear evidence of what improved and why.
- Measurement discipline: Design evaluation criteria, check that they catch known failures before relying on them, and keep them honest as the work reveals cases they missed.
- Extrapolating to the core: Generalise what works for one client so that it serves a whole category of work. Contribute examples, evaluation criteria and findings to the relevant core squad, and write clear, evidenced requests where a client problem can only be solved in the platform.
- Reusable practice: Build and maintain a library of skills, evaluation patterns and engagement playbooks that make each new engagement faster than the last.
Similar roles at other companies
Software Engineer, Agent
OpenArtSan Carlos, California
$300K–$400K / yr
Posted Sep 10, 2026
$180K–$231K / yr
Posted Jul 29, 2026
Agent Architect
LitifyAnywhere
$110K–$120K / yr
Posted Aug 25, 2026
Lead AI/Agent Architect
Future WorksLondon +2
Pay not posted
Posted 2 days ago
Listed on Pencil's Ashby job board; checked 30 h ago. First seen by us 31 h ago. Being listed doesn't mean the team is actively interviewing. We found this board in a public directory and haven't yet confirmed it against the company's own careers page.