AI Data Operations Engineer

Job Description

• Own and coordinate product implementation initiatives across Indonesian market projects.
• Plan, monitor, and execute product-related projects while ensuring alignment with business objectives and project timelines.
• Prepare, clean, annotate, validate, and organize large-scale text and audio datasets for AI model development, particularly for NLP, ASR, NLU, and LLM-related projects.
• Conduct data quality reviews, testing, and validation to ensure datasets meet project requirements and maintain high accuracy standards.
• Evaluate AI-generated outputs, including conversational AI, chatbots, voice assistants, and LLM responses, ensuring linguistic accuracy, contextual relevance, and cultural appropriateness for Indonesian users.
• Identify data quality issues, analyze root causes, and provide actionable recommendations to improve AI model performance.
• Perform prompt evaluation, response analysis, and benchmarking for LLM and Retrieval-Augmented Generation (RAG) applications.
• Coordinate cross-functional stakeholders, including Product, AI Engineering, Operations, Customer Success, and Business teams throughout the project lifecycle.
• Develop, maintain, and improve annotation guidelines, testing standards, evaluation frameworks, and quality assurance documentation.
• Support user acceptance testing (UAT), product validation, and post-launch monitoring.
• Contribute to the continuous improvement of operational frameworks, internal processes, and project governance.
• Manage the end-to-end workflow of freelance contributors, including task allocation, progress tracking, quality review, and performance monitoring.

Requirements

• Bachelor’s degree in Computer Science, Data Science, Information Systems, Statistics, Linguistics, Engineering, or a related field.
• Minimum 2 – 3 years of experience in Product Operations, Product Coordination, AI Data Operations, Data Annotation, Data Analysis, Product Implementation, Project Management in AI Model Optimization
• Experience on handling multiple projects on AI model optimization, NLP, LLM, Conversational AI, Chatbot, Speech Recognition (ASR), or Natural Language Understanding (NLU) projects is highly preferred.
• Experience in handling large-scale datasets, including data cleaning, data preprocessing, data analysis, and data validation to ensure data quality and accuracy.
• Solid understanding of AI data lifecycle, data quality management, annotation methodologies, and model evaluation processes.
• Familiarity with LLMs, prompt evaluation, or generative AI workflows is a strong advantage.
• Experience managing cross-functional projects and coordinating multiple stakeholders simultaneously.
• Strong analytical thinking with the ability to identify issues and recommend practical solutions.
• Experience handling large or unstructured datasets and conducting manual quality reviews.
• Proficient in Microsoft Excel and basic Python for data processing and analysis.
• Excellent documentation, communication, and organizational skills.
• Native Indonesian speaker with strong written and verbal communication skills in both Indonesian and English.
• Able to work independently while collaborating effectively in a fast-paced, project-driven environment.
• Comfortable managing multiple priorities and meeting project deadlines.

About AI Rudder

AI Rudder is an AI product company transforming how business communicate to their customers.

We launched in 2019 with one of the world’s first enterprise-grade AI voice agents: built to hold real, intelligent conversations, not just play back scripts. Today, we serve over 500 enterprises across 20+ countries, processing 50 million calls every day and having delivered more than 8 billion calls to date. Our customers range from fast-growing startups to large enterprises.

When AI talks to people, it has to feel human. That’s what we build.

How We Work

AI-first: AI isn’t a tool we reach for. It’s the default we start from. Every team, every workflow: AI-first.

Global Collaboration: We operate globally and work as one team. Distance is a logistics problem, not a cultural one. We build the habits that make distributed teams actually work

Communication Principle: Simple, Trust, Transparent. We remove unnecessary complexity so people can focus on what matters most.

What We Offer

• Learning & Development: Continuous learning through real projects, knowledge sharing session, mentorship, and cross-functional collaboration.
• Performance Recognition: Regular performance reviews, feedback, and opportunities for career progression.
• Global Exposure: Collaborate with international teams, global rotations, and work with global enterprise customers.
• Meaningful Impact: Build AI solutions that create real value for businesses around the world.
• Ownership & Autonomy: Freedom to take initiative and drive outcomes.
• Team Engagement: Team Building, Local & Global Gatherings & Local Events Celebration

AI Rudder is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees and applicants.