Overview:
The Highspring Prompt Engineering team operates on the application of artificial intelligence for data labeling operations. Our mission is to leverage the power of Large Language Models (LLMs) like Gemini to solve complex business challenges, enhance operational efficiency, and build intelligent tools for clients. We are a hands-on team that moves quickly from concept to prototype, working across multiple products and disciplines to deliver high-impact solutions.
This is a vendor role with Highspring for a client's team, a Fortune 100 company. This position is currently remote in the United States until further notice.
Responsibilities
* Prompt Based Tooling: Design and iteratively refine prompts for LLM-based tools to solve specific
business problems, including QA automation, LLM Content Generation, and guidelines-based
classification.
* A/B Testing: Execute plans to rigorously measure prompt performance, analyze results, and translate
quantitative and qualitative findings into actionable prompt improvements.
* Prototyping: Familiar with LLM-powered solutions such as interactive chatbots and integrated workflow
assistants.
* Collaboration: Work with cross-functional tema including product, engineering, UX, and operations, to
define requirements, demonstrate feasibility, and integrate LLM solutions.
* Context Enginnering: Planning how to use date pipelines for prompts, utilizing techniques like URL
crawling and SERP analysis to ground LLM responses and improve accuracy.
* Communication: be able to document findings, best practices, and project plans to communicate
progress and share knowledge across the organization.
Minimum Qualifications
* Experience or education in a computer science related field
* 1-2 years of hands-on experience with Python for scripting, data manipulation, or tool development.
* 1-2 years of experience working with Large Language Models (LLMs) and prompt engineering.
* Experience with designing and analyzing experiments or A/B testing
Preferred Qualifications
* Experience interacting with LLM APIs (e.g., Gemini API, OpenAI API_ and building simple applications or
scripts that use them.
* Proven ability to develop project plans, influence cross-functional partners, and deliver results in a
fast-paced environment.
* Experience designing and executing human evaluation methodologies for AI/ML systems.
* Familiarity with the full life cycle of a machine learning project, from ideation and prototyping to
evaluation and iteration.
* Excellent analytical, problem-solving, and communication skills
Schedule Requirements
* Weekday PST day shift (full time between 7 am to 5 pm range)
This Role Offers:
* Full Time (40 hrs/week), hourly
* Paid Time off, parenting leave
* Health benefits with low premiums
* Access to a comprehensive well-being program with resources to support physical and mental health:
* Employee Assistance Program, Live and recorded meditation, Yoga, Webinars, Events, Resilience skill
building, and more.
Desired Skills and Experience
Minimum Qualifications
* Experience or education in a computer science related field
* 1-2 years of hands-on experience with Python for scripting, data manipulation, or tool development.
* 1-2 years of experience working with Large Language Models (LLMs) and prompt engineering.
* Experience with designing and analyzing experiments or A/B testing
Preferred Qualifications
* Experience interacting with LLM APIs (e.g., Gemini API, OpenAI API_ and building simple applications or
scripts that use them.
* Proven ability to develop project plans, influence cross-functional partners, and deliver results in a
fast-paced environment.
* Experience designing and executing human evaluation methodologies for AI/ML systems.
* Familiarity with the full life cycle of a machine learning project, from ideation and prototyping to
evaluation and iteration.
* Excellent analytical, problem-solving, and communication skills
Vaco PLC is acting as an Employment Business in relation to this vacancy.
