Senior HPC Systems Validation Engineer
•Lambda· 4h
🏷️ Data Science⏰ Full-time⭐ Senior💰 $255k-340k🇺🇸 San Jose, USA
4h ago
Alephalpha·5 months ago
Aleph Alpha is one of the few companies in Europe with end-to-end in-house model development including pre- and post-training. We’re building models that have general-purpose capabilities, but also specifically excel at addressing the needs of our customers.
We're growing our post-training team in Heidelberg (or hybrid in Germany) and are looking for an AI Researcher who combines a deep theoretical understanding of reinforcement learning methods with a desire to improve on the state of the art and improve model capabilities in large-scale training.
Team Culture
At Aleph Alpha, we foster a culture built on ownership, autonomy, and empowerment. Teams and individual contributors are trusted to take responsibility for their work and drive meaningful impact. We maintain a flat organizational structure with efficient, supportive management that enables quick decision‑making, open communication, and a strong sense of shared purpose.
As a Senior AI Researcher for reinforcement learning you will shape and improve the underlying RL methodology, maintain a high-quality training code-base, and conduct large-scale experiments to hill-climb our performance benchmarks. This role is for you if you both have a strong theoretical background on RL and the engineering drive to bring these methods into production and improve on the methods as part of the reinforcement learning team.
In your day-to-day you will conduct large-scale reinforcement learning experiments, derive hypotheses from the results, and iterate on both the implementation and methodology based on the observations. Together with a collaborative team, you will have direct impact on the models that we ship to our customers.
This role is for Aleph Alpha Research GmbH.
Hill-climb in large-scale training: Conduct large-scale LLM training runs, analyze evaluation scores in depth, propose hypotheses for improvement and directly implement them in order to maximize performance on our benchmarks.
Theoretical innovation: Stay at the bleeding edge of RL research. You will identify, implement, and iterate on novel approaches to multi-turn reinforcement learning.
Scale our training infrastructure: Identify bottlenecks in our training setup and optimize our RL training loops for large-scale training.
Cross-functional collaboration: Partner with our other post-training teams to turn raw feedback into actionable training signals, ensuring that our RL iterations lead to measurable improvements in downstream performance.
Basic Qualifications
A deep understanding of Reinforcement Learning theory and how it relates to modern RL methods.
Experience with multi-node LLM training (ideally using RL). You understand how to scale multi-node RL trainings and can reason about and implement distributed algorithms.
Familiarity with statistical methods for evaluation and experiment design.
Ability to reason about what an evaluation/environment measures and whether it matters - not just run benchmarks, but understand them.
Strong Python skills and comfort with ML tooling (especially torch distributed)
Willingness to relocate to Heidelberg or travel regularly (potentially weekly).
Preferred Qualifications
PhD in reinforcement learning or equivalent research experience.
A history of contributions to top-tier venues (NeurIPS, ICML, ICLR, etc.) specifically regarding RL.
Experience evaluating LLM models and crafting environments for training.
Become part of an AI revolution!
30 days of paid vacation
Access to a variety of fitness & wellness offerings via Wellhub
Mental health support through nilo.health
Substantially subsidized company pension plan for your future security
Subsidized Germany-wide transportation ticket
Budget for additional technical equipment
Flexible working hours for better work-life balance and hybrid working model
JobRad® Bike Lease