Senior AI Researcher - Pre-training (f/m/d)

One-Click Apply

Alephalpha · Heidelberg, Germany

Full-timeRemote1mo ago30+ days old, may be filled

Machine LearningPythonPyTorch

Cover Letter Connect

Your profile and resume will be shared with the employer.

Prepare for this interview

Elite

AI-generated questions, company research, and talking points tailored to this role

About the role

As a Senior AI Researcher in Pre-training, you will work on the core technical problems that determine whether large-scale pre-training succeeds: architecture, optimisation, stability, and scaling up. You will work at the intersection of model architecture, training dynamics, and large-scale distributed training, translating empirical observations into principled training decisions. From small-scale proxy experiments to multi-thousand-GPU runs, you will ensure our models converge as expected and scale efficiently. We are looking for someone who combines significant research experience with strong engineering ability. You should be comfortable reasoning mathematically about training behaviour, designing rigorous experiments, and maintaining a high-quality production codebase. Your work sits at high leverage: the training decisions you make directly determine model quality, run reliability, inference efficiency, and how quickly we can improve the next generation of models. You'll have direct influence on the models we ship.

Responsibilities

Training Recipe Optimisation: Own and improve core elements of the training recipe, including optimiser settings, learning rate schedules, initialisation, regularisation, and other choices that materially affect convergence, stability, and final model quality.

Model Architecture Development: Design, implement, and evaluate architectural improvements in PyTorch, with a focus on training stability, scalability, efficiency in training and inference, and overall model performance.

Training Stability and Diagnostics: Investigate and resolve convergence issues such as loss spikes, divergence, optimiser pathologies, or numerical instability, and develop diagnostics that improve visibility into training health.

System-Model Co-Design: Collaborate with the Compute Performance, Data, Evaluation, and Post-Training teams to ensure full pipeline alignment across the model lifecycle, while satisfying performance requirements and hardware constraints (e.g., memory bandwidth and communication topology).

Distributed Training Debugging: Diagnose and resolve complex failures in large-scale distributed runs, including communication failures, race conditions, synchronisation issues, and other hard-to-reproduce problems.

Core Qualifications

You are proficient in Python and deeply familiar with PyTorch-based training workflows.

You have a strong track record in machine learning research and software engineering, demonstrated through shipped models, impactful open-source contributions, or published research.

You have a strong mathematical foundation and are comfortable reasoning formally about optimisation, scaling behaviour, and training dynamics.

You deeply understand transformer training dynamics, optimisation, and the behaviour of large distributed training jobs.

You can design rigorous experiments, reason clearly from noisy results, and translate empirical observations into robust training decisions.

You apply strong software engineering practices, including writing maintainable, well-tested code and supporting reproducible experimentation workflows.

You are able to implement complex model architectures efficiently and reliably and to debug complex issues across model code, training dynamics, and distributed systems.

You collaborate effectively within a research and engineering team and communicate clearly about your work

Senior AI Researcher - Pre-training (f/m/d)

About the role

Responsibilities

Benefits

Additional Information

Your Match

Company Intel

What employees say

Interested in this role?