We are currently seeking a Prompt Engineer to join our team in Jersey City, New Jersey (US-NJ), United States (US).

Prompt Engineer

LLM Interaction Design / Prompt Optimization / GenAI Application Quality

Role purpose

Design, test, govern, and continuously improve prompts, system instructions, conversation flows, and interaction patterns for AIRP LLM applications and related citizen-development experiences. The role ensures model outputs are accurate, grounded, safe, consistent, cost-aware, and aligned with business and compliance expectations.

Client-specific emphasis

• Prompt work must support enterprise business use cases, not generic chatbot experimentation. • Reusable prompt patterns should be suitable for AIRP and, where applicable, Copilot Studio / Power Platform citizen-development scenarios. • Candidates must understand prompt security, sensitive data handling, citations/grounding, and structured evaluation.

Primary ownership

• Prompt patterns, system instructions, response templates, and conversation policies for AIRP LLM use cases. • Prompt testing, versioning, evaluation, and quality-improvement workflows. • Reusable prompt libraries and guardrail patterns for business teams and responsible citizen development where applicable.

Key responsibilities

• Design prompts for chatbots, copilots, RAG systems, document analysis, summarization, workflow agents, knowledge assistants, and decision-support experiences. • Develop system prompts, few-shot examples, tool-use instructions, response formats, escalation logic, citation behavior, and conversation policies. • Optimize prompts for KYC support, credit underwriting support, governance tracking, pitch book generation, Banker 360, Customer 360, deal library intelligence, financial crime quality, and sanctions screening use cases. • Build reusable prompt libraries and templates aligned to enterprise standards, business domains, AIRP patterns, and citizen-development guardrails. • Evaluate prompt performance using metrics such as task success, groundedness, hallucination rate, completeness, safety, user satisfaction, latency, and token cost. • Partner with engineers to implement prompt versioning, testing, deployment, and monitoring in production systems and CI/CD workflows. • Support RAG quality by assessing retrieval context, chunking quality, source citation behavior, response synthesis, and missing-context behavior. • Conduct adversarial testing for prompt injection, jailbreaks, instruction conflicts, sensitive-data leakage, unsafe outputs, and unauthorized tool use.

Basic Qualifications:

• 3+ years of experience with LLM behavior, prompt design, tokenization, context windows, RAG, embeddings, and model limitations. • 3+ years of experience experience with OpenAI APIs, Azure OpenAI, AWS Bedrock, Anthropic, LangChain, LlamaIndex, Semantic Kernel, Copilot Studio, or similar platforms. • 3+ years of experience debugging LLM outputs using structured testing, error analysis, and iterative refinement. • 3+ years of experience with prompt-security risks including prompt injection, jailbreaks, data leakage, hallucination, and instruction conflicts. • 3+ years of experience creating repeatable prompt templates and evaluation evidence suitable for enterprise governance.

Preferred experience

• Strong writing, analytical, communication, and stakeholder-management skills. • Background in NLP, conversational AI, UX writing, technical writing, product design, knowledge management, business analysis, or financial-services operations. • Experience in financial services, legal, compliance, risk, operations, customer support, banker productivity, or enterprise knowledge domains. • Familiarity with Microsoft Copilot Studio, Power Platform, prompt registries, A/B testing, human review workflows, and evaluation tooling.

NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is $104,904 - $182,125 per year. Actual compensation will depend on a number of factors, including the candidate's relevant experience, technical skills, and other qualifications. This position may also be eligible for incentive compensation based on individual and/or company performance.

This position is eligible for company benefits including medical, dental, and vision insurance with an employer contribution, flexible spending or health savings account, life and AD&D insurance, short and long term disability coverage, paid time off, employee assistance, participation in a 401k program with company match, and additional voluntary or legally-required benefits.

LI-NorthAmerica, #DataFID

The Nippon Telegraph and Telephone Corporation (NTT)

New Jobs

Prompt Engineer