Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:
ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.
Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.
Summary of the role:
Oversees multi-project portfolios for AI training data programs. Leads delivery and scale: capacity planning, vendor management, and process automation. Ensures quality is consistent across projects, drives performance improvements, and plans work jointly with the Sr. Quality Analyst. Oversees a portfolio of programs that deliver and scale Generative AI data operations, including capacity planning, vendor management, and process automation. Builds processes and systems for audio/video data collection projects.
Key Responsibilities
- Portfolio delivery: Plan and run a group of projects (collection, labeling, evaluation) end-to-end; set priorities, milestones, and handoffs across time zones.
- Governance & reporting: Run cadence (status, risk, exec updates); align scope and budget with account and operations leads.
- Capacity planning: Forecast and secure rater/annotator capacity; balance shifts, throughput, and skills across vendors and internal teams.
- Quality consistency: Partner with the Sr. Quality Analyst on acceptance criteria, audits, and corrective actions; keep guidelines aligned across projects.
- Process automation & tooling: Identify manual steps; pilot automation with Ops Tech (templates, scripts, RPA, API-driven flows); scale what works.
- Vendor management: Set expectations, SLAs, and playbooks; review performance and drive improvements or changes as needed.
- Financial control: Build and track budgets, burn, and margins; manage change orders to protect financial outcomes.
- Risk, issue & change: Lead root-cause and action plans; escalate high-impact items with options and impact.
- Client and stakeholder management: Lead planning and QBR-style reviews; explain results, risks, and next steps in clear terms.
- Team enablement: Coach P1 PMs and C2–C3 Coordinators on planning, QA, and tools; support onboarding and skills growth (no formal line management required).
- Compliance & security: Ensure data handling, privacy, and access controls are followed across all workstreams.
- People Management: Gather feedback, provide training and coaching, foster team cohesion through team-building activities, conduct performance reviews, and support staffing and retention efforts. Additionally, collaborate with PST, Finance and recruiters for onboarding, offboarding, and addressing employee needs, while maintaining clear communication and updated SOPs to guide team.
- Collaboration with Recruitment: Work closely with the recruiting team to manage hiring efforts by communicating requirements (e.g., language needs), upcoming projects, and candidate statuses. Review, evaluate, and select qualified candidates from recruiters and decide on next steps (e.g., assessments, interviews, or client presentation).
- Audio & Video data collection: Build scalable and replicable processes for audio and video data collection projects. These projects may include online in platform collection as well as in person collection in professional or ad-hoc recording studios.
- Collaboration with media engineers: Work closely with audio and video engineers to correctly set up recording spaces, choose and vet professional studios and ensure that recordings are of the hughes quality.
Skills
- Portfolio planning and governance across several projects at once.
- Clear communication with senior clients and internal leaders; runs planning and QBR-style reviews.
- Strong use of spreadsheets, PM/task boards, and basic BI; familiarity with SQL/ETL concepts is a plus.
- Sound judgment on scope, time, cost, and quality trade-offs.
- Negotiation and escalation to resolve risks, issues, and change.
- Coaching mindset; guides P1 PMs and C2–C3 Coordinators.
- Comfortable working with global, distributed teams (intermediate to advanced English).
- Knowledge of audio and video studio set up, recording equipment and data collection project management.
Additional Qualifications
- Near-native English with strong writing and editorial skills.
- Hands-on experience with generative AI tools (text, voice, or video).
- Background in QA testing, rubric design, or AI safety/ethics evaluation.
- Familiarity with data-annotation platforms and model-evaluation tools.
- Ability to interpret code, datasets, and system workflows at a conceptual level (no coding required).
- Able to work independently and manage workflows effectively in a remote environment.
- Multilingual ability beyond English.
Scope and Autonomy
- Owns outcomes for a portfolio of small/medium projects or a large multi-workstream program.
- Works independently; defines delivery approach and engages leaders for non-standard items.
- Joint planning and shared responsibility for quality and client outcomes with the Sr. Quality Analyst.
Education and Experience
- Education
- Bachelor’s degree or equivalent experience in business, operations, data/engineering, or similar.
- Experience
- 2–3 years leading multi-project portfolios or large multi-workstream programs in AI data, content review, labeling/annotation, or related fields.
- Background in capacity planning, vendor coordination, and quality systems; experience piloting or scaling process automation is a plus.
