AI prompt and quality engineer

CoinMarketCap • Full-time • Remote (Kuala Lumpur, MY) • 4d ago

Responsibilities

Quality Monitoring: Conduct daily quality assurance on AI Chatbot responses through manual sampling and user feedback to assess accuracy, relevance, and naturalness
Issue Resolution: Detect response-quality issues promptly; document root causes, propose actionable improvements, and follow through to closure
Model Tuning: Collaborate with engineering teams to optimize AI models by participating in data annotation, parameter adjustment, and other enhancement tasks to boost performance and answer quality
Data Analysis: Collect and analyze user-conversation data to uncover user needs and pain points, providing data-driven insights for optimization
Process Improvement: Refine quality-control workflows to increase efficiency and ensure standardization of QA and tuning processes

Requirements

Technical Skills
Solid understanding of AI Chatbot mechanisms and quality-evaluation criteria
Basic data-analysis skills; proficient in SQL, Excel, and related tools
Foundational knowledge of Natural Language Processing (NLP) and Machine Learning
Experience
2+ years of relevant experience; prior optimization experience with AI or conversational products is preferred
Experience with industry-leading AI Chatbot products is a strong plus
Soft Skills
Strong communication and collaboration abilities
Meticulous, patient, and adept at identifying and solving problems
Thrives in a fast-paced environment and demonstrates a strong learning aptitude

Related Jobs

2X • Full-time • Kuala Lumpur, MY • 3d ago

3d ago