SnapshotArtificial Intelligence is reshaping our world. Now you get to shape AI. This large and ambitious project aims to develop a groundbreaking family of advanced, multilingual, open source foundation models based on solid research on model architecture, data quality, scaling, generalizability, finetuning, and safety. It combines the unique expertise of leading AI companies and top academic labs to create models with stronger generalization and finetuning capabilities, as well as enhanced transparency and safety. This will be an inclusive, community-driven project designed to and foster a new wave of innovation and scientific advancement.
The teamThe Automated Machine Learning team at TU Eindhoven focusses on cutting-edge research to advance the capabilities of machine learning models, while also democratizing AI and leveraging it to help humanity. We are a team of scientists and engineers who aim to deeply understand, explain, and build AI systems that learn continually and automatically assemble themselves to learn faster and better. In addition to producing highly-cited research published at top academic venues, we build models and systems that are widely used by people every day. This work is part of a large and talented team with world-class labs and experts across Europe, supported by well-known companies with advanced knowledge of LLM development.
The roleWe are seeking a proficient and talented PhD student with a true passion for AI. You will play a pivotal role in a team exploring new model architectures, novel efficient finetuning and adaptation techniques, refining data to enhance learning and generalizability, creating benchmarks, and ensuring safety while contributing to state-of-the-art, human-centric LLM development with real-world impact.
Key responsibilities (depending on your expertise):As part of a team, you will focus on a subset of the following tasks, aligned with your strengths and interests:
- Research and develop innovative foundation model architectures and scaling laws.
- Explore efficient, cutting-edge finetuning and adaptation techniques based on transfer learning, meta-learning, and continual learning.
- Design and optimize data pipelines for pretraining models to enhance generalization.
- Create new benchmarks to assess safety and generalization abilities across diverse applications.
- Develop tools for continuous evaluation, benchmarking, and training monitoring.
- Collaborate to tackle challenging technical problems and publish research in top venues.
What we're looking forA self-driven researcher with strong expertise in machine learning. Knowledge of foundation models, LLMs, pretraining, finetuning, transfer learning, meta-learning, and/or continual learning is a plus. You should have strong technical and programming skills and a drive to create new things. We appreciate a collaborative mindset and eagerness to work with a consortium of leading researchers, companies and stakeholders.
ImpactThis is your chance to make a real-world impact by advancing open-source foundation models while collaborating with leading AI researchers and innovative companies. Gain invaluable new skills as you help democratize AI, develop cutting-edge models, and create more efficient fine-tuning techniques that empower responsible innovation and drive scientific progress.