Job Title: AI Prompt Engineer
Location: Fully Remote
Work Hours: 4 PM to 1:30 AM IST with daylight savings (Till 3 PM CST)
Experience Required: 2+ Years
As a Prompt Engineer, you will design, evaluate, and refine prompts that drive intelligent behavior in AI-enabled features across our platform. You will work closely with data scientists, engineers, and product leaders to develop prompt frameworks and dialogue flows that power agentic orchestration, helping patients navigate complex health journeys.
Responsibilities
Architect reusable prompt templates for multi-turn conversational flows, including clarification, escalation, human-in-the-loop, and action triggering
Work with engineers and data scientists to test and optimize RAG-based search prompts
Create and maintain prompt libraries with robust versioning and testing frameworks
Collaborate on agentic workflows that help agents act autonomously and intelligently across clinical, scheduling, and care navigation use cases
Evaluate prompt performance using real-time analytics and partner with the data science team to iterate
Support safe prompt handling of PHI, bias mitigation, and hallucination reduction
Develop challenger agents and evaluation agents to confirm agent output and ensure safe and consistent messaging to MyBSWHealth customers
Minimum Qualifications
- Bachelor's degree in Computer Science, Linguistics, Philosophy, Cognitive Science, or comparable experience in industry or a related field
- 2+ years working with LLMs (e.g., GPT, Claude, Mistral, etc.) in production settings
- Experience with prompt engineering, RAG, or agentic AI architectures
- Familiarity with healthcare – or other regulated industry - workflows, EHR systems, or clinical terminology is a plus
- Strong understanding of conversational UX and prompt evaluation metrics
- Experience with Pydantic AI python library and n8n workflow automation software suite preferred
