An end-to-end, mission-focused approach to GenAI
We take an end-to-end, mission-focused approach to GenAI research, training foundation models, enhancing the technical possibilities with generative AI and developing systems that reflect the values we work to ingrain.
We are committed to responsible and open research. We raise the bar on openness, responsibly sharing all innovations without obfuscation.

Highlight Contributions

In awe at the scale of these tensors – a gentle introduction to Unit-Scaled Maximal Update Parametrization

T-Free: Hierarchical Autoregressive Transformers for Language Fairness and Sovereignty
Our Principles
While our research is foundational, it always aims to address real industry needs & set standards for GenAI applications.
We are responsibly sharing our innovation, often by publishing them including papers, blog posts & codebases. This allows our research to be transparent and visible to the community.
Teams are mostly self-organizing and consist entirely of researchers and engineers. This way we ensure all voices are heard and are able to maximize technical influence of individual contributors, regardless of career level.
AlphaOne, our datacenter, is one of the most powerful in Europe, and is managed by the Aleph Alpha infrastructure team. This way, we are able to to provide our team a high GPU/head ratio and experimental/ innovative hardware.
Research Contributions

T-Free: Hierarchical Autoregressive Transformers for Language Fairness and Sovereignty

In awe at the scale of these tensors – a gentle introduction to Unit-Scaled Maximal Update Parametrization

Words don’t come easy (… to LLMs): Universal Text-Encoding for dynamic, multi-lingual alphabets revolutionizing efficiency and effectiveness for LLM training and inference

Introducing Pharia-1-LLM: transparent and compliant

Open-sourcing Codebase Scaling for Non-commercial Research

Quality Diversity through AI Feedback

Luminous Performance Benchmarks
Join the Aleph Alpha Team
Be part of a wild, ambitious and high performing team, of people living their best work life
Our Tenets
We take responsibility for every stage of the process, ensuring that our work is complete, scalable, and of the highest quality. We embrace accountability and continuously seek improvements along the way.
Our focus is on solving real, immediate problems for our customers and the research community. We prioritize delivering impactful solutions that bring value and make a difference.
We share our work openly to our partners, customers, and the broader community through publishing and sharing results and insight including blogposts, papers, checkpoints, and more.
We strive to balance ideas and interests of our team with our mission-backwards approach, and acknowledge the interdisciplinary, diverse perspectives in our team.