About LetitbexAI
LetitbexAI is a fast-growing AI-driven technology company focused on building intelligent, scalable, and enterprise-grade solutions. We work at the intersection of AI, data engineering, cloud, and business transformation, helping organizations unlock real value from artificial intelligence.
Position: Prompt / LLM Engineer
Experience: 3-5 Years
Notice Period: Can be considered up 15 Days
Role Summary
Specialize in designing, optimizing, and evaluating prompts for LLMs in various products. Build frameworks for systematic prompt engineering and ensure high-quality LLM outputs for various tasks.
Key Responsibilities
- Design and optimize prompts for LLM-based tasks related to various products.
- Conduct systematic experimentation to evaluate prompt performance and quality
- Implement prompt versioning and A/B testing frameworks
- Build evaluation rubrics and quality metrics for LLM outputs
- Implement Retrieval Augmented Generation (RAG) patterns for contextual accuracy
- Collaborate with product and engineering teams on LLM integration and deployment
- Document prompt strategies, patterns, and best practices
- Research and evaluate new LLM models and APIs for applications to be developed
- Manage cost optimization and latency improvements for LLM usage
Required Skills & Experience
- 3-5 years of experience in AI/ML engineering or AI product development
- Deep hands-on experience with LLMs (GPT-4, Claude, LLaMA, etc.)
- Strong understanding of prompt engineering techniques and evaluation methodologies
- Experience with LLM APIs and integration patterns
- Knowledge of NLP concepts and language models
- Proficiency in Python and ability to work with code-based prompting frameworks
- Strong analytical skills and attention to quality
- Excellent communication and documentation skills
Nice to Have
- Experience with RAG systems and vector databases
- Knowledge of fine-tuning LLMs for specific domains
- Experience in HR tech domain & Vendor Management Systems
- Published research or case studies on prompt engineering
- Experience with LangChain, LlamaIndex, or similar frameworks
