Job Description
Job Information
Location: Los Angeles, CA (Remote)
Machine Learning & Artificial Intelligence
Role: AI Prompt Engineer
Overview
Design, refine, and scale prompt strategies for large language models (LLMs) and generative AI to produce accurate, reliable, and high-value AI outputs. This role involves translating business needs into prompt frameworks, experimentation, optimization, and building reusable prompt patterns while ensuring quality, safety, and ethical AI practices.
Key Responsibilities
- Design and optimize prompts for LLMs and generative AI.
- Develop engineering frameworks and guidelines for AI use cases.
- Systematically test and iterate on prompts to improve performance.
- Build reusable prompt templates and libraries.
- Implement prompt chaining and multi-step reasoning.
- Design and optimize Retrieval-Augmented Generation (RAG) systems.
- Evaluate AI model outputs and implement improvement strategies.
- Conduct prompt injection testing and implement safeguards.
- Collaborate with developers for prompt integration.
- Monitor prompt performance and implement A/B testing.
- Document prompt techniques and findings.
- Stay current with LLM capabilities and best practices.
- Provide guidance on prompt engineering.
- Analyze failure modes and improve robustness.
- Implement ethical AI practices.
- Make decisions on prompt strategies and model selection.
Qualifications
- 5+ years of experience in AI/ML, NLP, or software development with a focus on LLMs and generative AI; demonstrated expertise in prompt engineering.
- Proficiency in prompt engineering and design for LLMs (e.g., GPT, Claude, Llama).
- Understanding of transformer architectures and LLM language processing.
- Knowledge of Natural Language Processing (NLP) and computational linguistics.
- Experience with systematic testing and experimentation methodologies.
- Understanding of AI safety and responsible AI practices.
- Proven ability to craft high-quality, reliable AI outputs via prompts.
- Deep understanding of LLM capabilities, limitations, and behaviors.
- Experience with various prompting techniques (e.g., few-shot learning, chain-of-thought).
- Strong analytical and creative problem-solving skills.
- Proficiency in Python for prompt automation and testing.
- Experience with LLM APIs (e.g., OpenAI, Anthropic, Azure OpenAI).
- Knowledge of RAG architectures and vector databases.
- Understanding of fine-tuning and model customization.
- Familiarity with LLM evaluation frameworks and metrics.
- Experience with prompt management tools and platforms.
- Knowledge of conversational AI and chatbot design.
- Understanding of AI ethics, bias, and safety considerations.
Education
- Minimum: Bachelor's degree in Computer Science, Computational Linguistics, Data Science, Artificial Intelligence, or related field.
- Preferred: Master's degree in AI, NLP, Computer Science, or related field; portfolio demonstrating prompt engineering projects.
- Certifications: AI/ML, LLM-specific, or prompt engineering certifications are valuable.
- Equivalent Experience: 5+ years of hands-on experience with LLMs and generative AI, with a proven track record in prompt engineering, may substitute for an advanced degree.
Employment Type: FULL_TIME