LLM Product Delivery Specialist (Voicebot/Chatbot)

Job Description

Design and deliver end-to-end Voicebot/Chatbot solutions powered by LLMs, including prompt writing and tuning, conversation flow design, intent configuration, and knowledge base setup — from initial launch through continuous iteration.

Analyze conversation data and conduct bad case attribution to identify model output issues such as hallucinations, instruction-following gaps, and multi-turn context loss, then develop and execute optimization strategies.

Write Python scripts to support day-to-day work, including batch test case execution, conversation log cleaning and analysis, and automated performance metric reporting.

Manage the full project delivery lifecycle — coordinate internal and external stakeholders (business teams, tech teams, vendors), track timelines and quality, and provide regular updates on bot performance.

Stay current on LLM and conversational AI developments, evaluate new capabilities for business applicability, and drive continuous product improvement and user experience enhancement.

Collaborate across teams to support other project needs and contribute to operational planning for new product rollouts.

Requirements

Bachelor’s degree or above; able to communicate professionally in English.

2+ years of experience in Chatbot or Voicebot product delivery; hands-on experience with LLM applications (Prompt Engineering, RAG, Agent workflows) is a strong plus.

Some technical background — able to read and understand code logic, comfortable with basic Python for data processing, API calls, and script writing; or a strong PM background with solid understanding of technical implementation.

Familiar with at least one major LLM platform or framework such as OpenAI API, Claude, Coze, or Dify; understands the basics of prompt tuning and model evaluation.

Strong data analysis skills — able to use conversation logs and business metrics to drive optimization decisions

Clear logical thinking and strong writing skills — able to translate business requirements into structured prompts and well-designed conversation flows.

Self-driven and results-oriented; comfortable working in a fast-paced, multi-threaded environment with strong execution and learning agility.

Strong cross-team communication and coordination skills — able to drive progress efficiently in multi-stakeholder environments.

Based in the Philippines; open to occasional remote collaboration across time zones.

About AI Rudder

AI Rudder is an AI product company transforming how business communicate to their customers.

We launched in 2019 with one of the world’s first enterprise-grade AI voice agents: built to hold real, intelligent conversations, not just play back scripts. Today, we serve over 500 enterprises across 20+ countries, processing 50 million calls every day and having delivered more than 8 billion calls to date. Our customers range from fast-growing startups to large enterprises.

When AI talks to people, it has to feel human. That’s what we build.

How We Work

AI-first: AI isn’t a tool we reach for. It’s the default we start from. Every team, every workflow: AI-first.

Global Collaboration: We operate globally and work as one team. Distance is a logistics problem, not a cultural one. We build the habits that make distributed teams actually work

Communication Principle: Simple, Trust, Transparent. We remove unnecessary complexity so people can focus on what matters most.

What We Offer

• Learning & Development: Continuous learning through real projects, knowledge sharing session, mentorship, and cross-functional collaboration.
• Performance Recognition: Regular performance reviews, feedback, and opportunities for career progression.
• Global Exposure: Collaborate with international teams, global rotations, and work with global enterprise customers.
• Meaningful Impact: Build AI solutions that create real value for businesses around the world.
• Ownership & Autonomy: Freedom to take initiative and drive outcomes.
• Team Engagement: Team Building, Local & Global Gatherings & Local Events Celebration

AI Rudder is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees and applicants.