San Francisco | Onsite
$90K to $130K + equity
Multiple Vacancies
We’re working with a fast-growing AI company in San Francisco building sophisticated conversational AI agents for enterprise customers.
They’re looking for an AI Prompt & Conversation Specialist to take ownership of how production AI agents communicate, respond and improve over time.
This is not a traditional software engineering role. It sits at the intersection of prompt engineering, conversational AI, language, data analysis and product.
You’ll work directly with real-world interaction data, identify where AI agents are failing and systematically improve their behaviour through prompting, evaluation and experimentation.
What you'll be doing:
• Write, test and improve prompts running in production
• Own specific areas of conversational agent behaviour
• Analyse large volumes of real customer interactions
• Identify failure patterns and deploy improvements
• Build evaluation datasets and testing frameworks
• Design and improve agent and sub-agent workflows
• Run experiments and measure the impact of changes
• Improve conversational tone, language and edge-case handling
• Monitor production performance and identify behavioural drift
• Work closely with engineering, product and customer-facing teams
What we're looking for:
• 2+ years of professional experience
• Hands-on prompt engineering experience with production AI systems
• Experience owning prompts or agent behaviour used by real customers
• Strong analytical skills and confidence working with large datasets
• Excellent writing, language and reading comprehension
• A highly organised and methodical approach to experimentation
• Experience with AI evaluation, testing or prompt optimisation
• Comfortable reading Python and working around TypeScript
We’re particularly interested in candidates from either an AI-native prompt or conversational AI background or those with strong linguistics, philosophy, law or other language and logic-heavy training who have developed substantial hands-on AI expertise.
Experience with voice AI, TTS, ASR or telephony platforms would be a strong advantage but isn't essential.
This would suit someone who is fascinated by why AI agents behave the way they do and wants to spend their time analysing real interactions, fixing failures and making production AI measurably better.
Location: San Francisco
Salary: $90K to $130K with flexibility for exceptional candidates
Equity: Competitive
Visa: Existing US work authorisation required