In the context of Frank’s ERC grant and several other grants for basic research on automated deep learning, neural architecture search, efficient hyperparameter optimization, learning to learn, and AutoML in general (more details below), we have several open positions for outstanding postdocs at ML Freiburg. We also have several open positions for outstanding research engineers.
Topics of particular interest to the group include:
- Neural architecture search
- Efficient hyperparameter optimization
- Learning to learn
- Hyperparameter control
- Meta learning and transfer learning
- Bayesian optimization
- Optimization of neural networks
- Invertible networks
- Deep reinforcement learning
- Evolutionary algorithms
- Algorithm configuration and selection
- Discrete optimization and NP-hard problem solving
- Data-driven analysis of algorithms, hyperparameter importance, problem hardness, etc.
- Improving Auto-PyTorch
- Improving Auto-sklearn
Demonstrated hands-on experience in one or more of these areas is a requirement. Postdoc applicants should have an excellent publication record and a PhD in artificial intelligence, machine learning, computer science, statistics or a related discipline. Research engineer applicants should have excellent coding skills, as well as practical skills in data science and/or deep learning, and experience with scripting and running large-scale experiments. (The group is almost exclusively using Pytorch as a deep learning framework.)
The salary scale for full-time positions is TV-L E13 to TV-L E14, with a monthly gross salary between 4000 EUR and 4600 EUR, depending on experience and previous position.
Application materials comprise:
- Full set of transcripts
- Statement of purpose
- Briefly state what drives you and what are your goals in applying to ML Freiburg
- Names for at least 2 reference letter writers
- For each reference, please include name, title, and email address.
- References should expect to be contacted for a reference letter.
Please submit these documents to email@example.com.
Frank’s ERC grant. This grant of 1.5 million Euros ($1.76 million US) is given for a project on automated deep learning, which facilitates the transformation of deep learning from somewhat of an art to a principled engineering science. This involves efficient neural architecture search, hyperparameter optimization, deep reinforcement learning to learn better optimizers, and a substantial component on understanding the performance of deep learning using a data-driven approach. In general, ERC grants are Europe’s most prestigious funding instrument, focused purely on an excellence-based approach to science. As stated in a recent Nature article, the ERC has helped Europe to “surpass the United States in terms of the most-cited scientific publications” and is “recognized as the best in the world in the way it supports fundamental research“.
The ML Freiburg group. Currently comprising 2 postdocs, 10 PhD students and one research engineer, ML Freiburg is amongst the leading groups in AutoML worldwide, with a focus on automated deep learning. This includes efficient neural architecture search, efficient hyperparameter optimization, learning to learn, and automated algorithm design using ML in general. The group has won the first two international AutoML challenges (2015-2016 and 2017-2018), with continuously improving versions of its widely-used open-source tool Auto-sklearn and is also building the automated deep learning tool Auto-PyTorch. Frank co-started the AutoML workshop series at ICML in 2014 and has been co-chairing it every year since. He also co-started the workshop series on Bayesian optimization at NeurIPS (since 2011), meta-learning at NeurIPS (since 2017), neural architecture search at ICLR (since 2020) and co-edited the AutoML book. The group developed the best available out-of-the-box tool for efficient hyperparameter optimization of neural networks and is amongst the world’s leading groups in neural architecture search and various other meta-algorithmic problems, such as algorithm configuration and algorithm selection, which have led to world championship titles in SAT solving and AI planning.
Resources and collaboration opportunities. ML Freiburg owns several large compute clusters, comprising about 300 GPUs and 1500 CPU cores. It also has (non-exclusive) access to a central cluster with 15.000 CPU cores. The group collaborates closely with the Bosch Center for Artificial Intelligence, which funds basic research on AutoML in the group with 6.4 million euros over 4 years. The group collaborates closely with the other AI groups in Freiburg’s ELLIS unit, especially Thomas Brox’ computer vision group (leading to several new advances in neural architecture search), Tonio Ball’s neuromedical AI lab (leading to the first published work achieving state-of-the-art performance in EEG decoding with deep learning), Wolfram Burgard’s robotics group, Joschka Boedecker’s neurorobotics group, Abhinav Valada’s robot learning group and Josif Grabocka’s representation learning group. All of these groups are mostly working on deep learning and reinforcement learning these days, leading to exciting convergences and synergies. Frank is also Chief Expert AutoML at the Bosch Center for Artificial Intelligence. Finally, the University of Freiburg is one of 17 ELLIS units, and Frank is a fellow in the ELLIS programme on robust machine learning, opening up many opportunities for collaboration with other machine learning hot spots in Europe.
The University of Freiburg. Founded in 1457, the University of Freiburg is one of the oldest German universities and is now one of the nation’s leading research and teaching institutions, evidenced amongst others by it being one of the 23 members of the League of European Research Universities (LERU). It actively fosters interdisciplinary research (e.g., the Excellence cluster BrainLinks-BrainTools, which, amongst others, researches on deep learning for neuroscience), and it is one of the few universities offering world class research environments in the classical as well as in the modern disciplines. More than 24,000 students from over 100 nations are studying in 180 degree programs at 11 faculties. The university also successfully attracted the highest third-party funding per-professor in all of Germany.
The University of Freiburg is one of the 17 excellent European universities that have been distinguished as ELLIS units for their excellence in machine learning. The university has a particularly strong group of faculty members in the field of artificial intelligence (including 3 ERC grant holders) covering a wide range of modern AI topics, such as machine learning, computer vision, robotics, planning, and control. The yearly budget in AI is more than 3M Euro and funds more than 50 PhD students. A robotics school and a deep learning compute cluster have been fostering the interdisciplinary research among AI researchers via the overarching methodology of deep learning. There are strong international relationships to other scientists and companies with an adjunct professor from DeepMind and three faculty members working
part time for Bosch, Toyota, and Amazon, respectively, and a faculty member advising the German parliament on AI. The AI research at the University transfers its results actively to other disciplines, such as the life sciences, sustainable systems engineering, and ethics. The AI researchers are involved in all four clusters of excellence as set up by the German government, one of these clusters being coordinated by a faculty member in AI.
Living in Freiburg. Founded in 1120, Freiburg is a lovely city with about 220.000 inhabitants in the very south west of Germany, about 30 minutes from both France and Switzerland. It is sunny, laid-back, and known for its charme and quality of life. As the gate to the Black Forest, Freiburg offers many outdoor activities, such as mountain biking, hiking, and skiing. The city was amongst Germany’s first to have a green major and in 2010, it was voted as the Academy of Urbanism’s European City of the Year in recognition of the exemplary sustainable urbanism it has implemented over the past several decades. The #1 mode of transportation is by bike. Life is good in Freiburg 🙂