Job Title: AI Prompt Engineer

Location: Fully Remote

Work Hours: 4 PM to 1:30 AM IST with daylight savings (Till 3 PM CST)

Experience Required: 2+ Years

As a Prompt Engineer, you will design, evaluate, and refine prompts that drive intelligent behavior in AI-enabled features across our platform. You will work closely with data scientists, engineers, and product leaders to develop prompt frameworks and dialogue flows that power agentic orchestration, helping patients navigate complex health journeys.

Responsibilities

Architect reusable prompt templates for multi-turn conversational flows, including clarification, escalation, human-in-the-loop, and action triggering

Work with engineers and data scientists to test and optimize RAG-based search prompts

Create and maintain prompt libraries with robust versioning and testing frameworks

Collaborate on agentic workflows that help agents act autonomously and intelligently across clinical, scheduling, and care navigation use cases

Evaluate prompt performance using real-time analytics and partner with the data science team to iterate

Support safe prompt handling of PHI, bias mitigation, and hallucination reduction

Develop challenger agents and evaluation agents to confirm agent output and ensure safe and consistent messaging to MyBSWHealth customers

Minimum Qualifications

Bachelor's degree in Computer Science, Linguistics, Philosophy, Cognitive Science, or comparable experience in industry or a related field
2+ years working with LLMs (e.g., GPT, Claude, Mistral, etc.) in production settings
Experience with prompt engineering, RAG, or agentic AI architectures
Familiarity with healthcare – or other regulated industry - workflows, EHR systems, or clinical terminology is a plus
Strong understanding of conversational UX and prompt evaluation metrics
Experience with Pydantic AI python library and n8n workflow automation software suite preferred

Jobs in Pune

Prompt Engineer