Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2021
Neural Architecture Search based on Cartesian Genetic Programming Coding Method Journal Article
In: Neural and Evolutionary Computing, 2021.
Exploring Robustness of Neural Networks through Graph Measures Technical Report
2021.
Towards One Shot Search Space Poisoning in Neural Architecture Search Technical Report
2021.
AutoCTS: Automated Correlated Time Series Forecasting Journal Article
In: Proc. VLDB Endow., vol. 15, no. 4, pp. 971–983, 2021.
RobustART: Benchmarking Robustness on Architecture Design and Training Techniques Technical Report
2021.
Automated Machine Learning for Satellite Data: Integrating Remote Sensing Pre-trained Models into AutoML Systems Proceedings Article
In: Dong, Yuxiao; Kourtellis, Nicolas; Hammer, Barbara; Lozano, José Antonio (Ed.): Machine Learning and Knowledge Discovery in Databases. Applied Data Science Track - European Conference, ECML PKDD 2021, Bilbao, Spain, September 13-17, 2021, Proceedings, Part V, pp. 447–462, Springer, 2021.
Memorize, Factorize, or be Na$backslash$ Technical Report
2021.
AutoMTL: A Programming Framework for Automated Multi-Task Learning Proceedings Article
In: NeurIPS 2022, 2021.
Neural network surgery: Combining training with topology optimization Journal Article
In: Neural Networks, vol. 144, pp. 384-393, 2021, ISSN: 0893-6080.
2020
APENAS: An Asynchronous Parallel Evolution Based Multi-objective Neural Architecture Search Proceedings Article
In: 2020 IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA), 2020.
DEff-ARTS: differentiable efficient ARchiTecture search Technical Report
2020.
Extending SpArSe: Automatic Gesture Recognition Architectures for Embedded Devices Proceedings Article
In: 2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 7-12, 2020.
MTNAS: Search Multi-Task Networks for Autonomous Driving Technical Report
2020.
Uncertainty quantification using Auto-tuned Surrogates of CFD model Simulating Supersonic flow over tactical missile body Proceedings Article
In: pp. 2885-2892, 2020.
Optimally designed Variational Autoencoders for Efficient Wind Characteristics Modelling Proceedings Article
In: pp. 2869-2876, 2020.
EvoFlow - A Python library for evolving deep neural network architectures in tensorflow Proceedings Article
In: pp. 2288-2295, 2020.
GPCNN - Evolving Convolutional Neural Networks using Genetic Programming Proceedings Article
In: pp. 2684-2691, 2020.
A Memetic Algorithm for Evolving Deep Convolutional Neural Network in Image Classification Proceedings Article
In: pp. 2663-2669, 2020.
Benefits of temporal information for appearance-based gaze estimation Technical Report
2020.
AutonoML - Towards an Integrated Framework for Autonomous Machine Learning Technical Report
2020.
WeightNet - Revisiting the Design Space of Weight Networks Proceedings Article
In: pp. 776-792, 2020.
FDNAS: Improving Data Privacy and Model Diversity in AutoML Technical Report
2020.
Neural Architecture Search with an Efficient Multiobjective Evolutionary Framework Technical Report
2020.
Evolving Neural Architecture Using One Shot Model Technical Report
2020.
Memory-Efficient Hierarchical Neural Architecture Search for Image Restoration Technical Report
2020.
Learning by Self-Explanation, with Application to Neural Architecture Search Technical Report
2020.
Small-Group Learning, with Application to Neural Architecture Search Technical Report
2020.
Searching for Controllable Image Restoration Networks Technical Report
2020.
Single-level Optimization For Differential Architecture Search Technical Report
2020.
Neural Architecture Search using Particle Swarm and Ant Colony Optimization Proceedings Article
In: pp. 229-240, 2020.
aw_nas: A Modularized and Extensible NAS framework Technical Report
2020.
EdgeNAS - Discovering Efficient Neural Architectures for Edge Systems Proceedings Article
In: pp. 288-295, 2020.
Optimizing FPGA-Based CNN Accelerator Using Differentiable Neural Architecture Search Proceedings Article
In: pp. 465-468, 2020.
A Graph-Based Approach to Automatic Convolutional Neural Network Construction for Image Classification Proceedings Article
In: pp. 1-6, 2020.
AutoCaption - Image Captioning with Neural Architecture Search Technical Report
2020.
Joint Search of Data Augmentation Policies and Network Architectures Technical Report
2020.
Distilling Optimal Neural Networks - Rapid Search in Diverse Spaces Technical Report
2020.
EfficientPose - Efficient Human Pose Estimation with Neural Architecture Search Technical Report
2020.
Differential Evolution for Neural Architecture Search Technical Report
2020.
AdvantageNAS - Efficient Neural Architecture Search with Credit Assignment Technical Report
2020.
Improving the Efficient Neural Architecture Search via Rewarding Modifications Proceedings Article
In: pp. 1-6, 2020.
Efficient Incorporation of Multiple Latency Targets in the Once-For-All Network Technical Report
2020.
Optimizing the Energy Consumption of Neural Networks Proceedings Article
In: pp. 2312-2319, 2020.
Evolutionary Generative Contribution Mappings Proceedings Article
In: pp. 1657-1664, 2020.
Auto-MVCNN - Neural Architecture Search for Multi-view 3D Shape Recognition Technical Report
2020.