Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2020
DeepMaker - A multi-objective optimization framework for deep neural networks in embedded systems Journal Article
In: vol. 73, pp. 102989, 2020.
Auto-ORVNet - Orientation-Boosted Volumetric Neural Architecture Search for 3D Shape Classification Journal Article
In: vol. 8, pp. 12942-12954, 2020.
NAS-Bench-201 - Extending the Scope of Reproducible Neural Architecture Search Proceedings Article
In: 2020.
Neural Architecture Search on Acoustic Scene Classification Proceedings Article
In: pp. 1171-1175, 2020.
TextNAS - A Neural Architecture Search Space Tailored for Text Representation Proceedings Article
In: pp. 9242-9249, 2020.
AtomNAS: Fine-Grained End-to-End Neural Architecture Search Technical Report
2020.
C2FNAS - Coarse-to-Fine Neural Architecture Search for 3D Medical Image Segmentation Proceedings Article
In: pp. 4125-4134, 2020.
Neural Architecture Search For Fault Diagnosis Technical Report
2020.
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Technical Report
2020.
APNAS - Accuracy-and-Performance-Aware Neural Architecture Search for Neural Hardware Accelerators Journal Article
In: vol. 8, pp. 165319-165334, 2020.
Generative Teaching Networks - Accelerating Neural Architecture Search by Learning to Generate Synthetic Training Data Proceedings Article
In: pp. 9206-9216, 2020.
UNAS - Differentiable Architecture Search Meets Reinforcement Learning Proceedings Article
In: pp. 11263-11272, 2020.
Efficient network architecture search via multiobjective particle swarm optimization based on decomposition Journal Article
In: vol. 123, pp. 305-316, 2020.
Neural architecture search for image saliency fusion Journal Article
In: vol. 57, pp. 89-101, 2020.
Ultrafast Photorealistic Style Transfer via Neural Architecture Search Proceedings Article
In: pp. 10443-10450, 2020.
AdversarialNAS - Adversarial Neural Architecture Search for GANs Proceedings Article
In: pp. 5679-5688, 2020.
SGAS - Sequential Greedy Architecture Search Proceedings Article
In: pp. 1617-1627, 2020.
Towards Oracle Knowledge Distillation with Neural Architecture Search Proceedings Article
In: pp. 4404-4411, 2020.
AutoML for Architecting Efficient and Specialized Neural Networks Journal Article
In: vol. 40, no. 1, pp. 75-82, 2020.
Self-supervised Representation Learning for Evolutionary Neural Architecture Search Technical Report
2020.
Fair DARTS - Eliminating Unfair Advantages in Differentiable Architecture Search Proceedings Article
In: pp. 465-480, 2020.
SGAS - Sequential Greedy Architecture Search Proceedings Article
In: pp. 1617-1627, 2020.
Meta-Learning of Neural Architectures for Few-Shot Learning Proceedings Article
In: pp. 12362-12372, 2020.
When NAS Meets Robustness - In Search of Robust Architectures Against Adversarial Attacks Proceedings Article
In: pp. 628-637, 2020.
SM-NAS - Structural-to-Modular Neural Architecture Search for Object Detection Proceedings Article
In: pp. 12661-12668, 2020.
AutoShrink - A Topology-Aware NAS for Discovering Efficient Neural Architecture Proceedings Article
In: pp. 6829-6836, 2020.
Search to Distill - Pearls Are Everywhere but Not the Eyes Proceedings Article
In: pp. 7536-7545, 2020.
EfficientDet - Scalable and Efficient Object Detection Proceedings Article
In: pp. 10778-10787, 2020.
Neural Predictor for Neural Architecture Search Proceedings Article
In: pp. 660-676, 2020.
S2DNAS - Transforming Static CNN Model for Dynamic Inference via Neural Architecture Search Proceedings Article
In: pp. 175-192, 2020.
Automatic Design of CNNs via Differentiable Neural Architecture Search for PolSAR Image Classification Journal Article
In: vol. 58, no. 9, pp. 6362-6375, 2020.
Improving Neuroevolution Using Island Extinction and Repopulation Technical Report
2020.
RAPDARTS - Resource-Aware Progressive Differentiable Architecture Search Proceedings Article
In: pp. 1-7, 2020.
ENAS oriented layer adaptive data scheduling strategy for resource limited hardware Journal Article
In: vol. 381, pp. 29-39, 2020.
Efficient Decoupled Neural Architecture Search by Structure And Operation Sampling Proceedings Article
In: pp. 4222-4226, 2020.
Searching Learning Strategy with Reinforcement Learning for 3D Medical Image Segmentation Technical Report
2020.
Automated design of error-resilient and hardware-efficient deep neural networks Journal Article
In: vol. 32, no. 24, pp. 18327-18345, 2020.
Efficient Residual Dense Block Search for Image Super-Resolution Proceedings Article
In: pp. 12007-12014, 2020.
Understanding and Robustifying Differentiable Architecture Search Proceedings Article
In: 2020.
Graph-Guided Architecture Search for Real-Time Semantic Segmentation Proceedings Article
In: pp. 4202-4211, 2020.
CARS - Continuous Evolution for Efficient Neural Architecture Search Proceedings Article
In: pp. 1826-1835, 2020.
Learning Image Labels On-the-fly for Training Robust Classification Models Technical Report
2020.
Once-for-All - Train One Network and Specialize it for Efficient Deployment Proceedings Article
In: 2020.
Automatic Design of Deep Networks with Neural Blocks Journal Article
In: vol. 12, no. 1, pp. 1-12, 2020.
A Generic Graph-based Neural Architecture Encoding Scheme for Predictor-based NAS Technical Report
2020.
MoGA - Searching Beyond Mobilenetv3 Proceedings Article
In: pp. 4042-4046, 2020.
Particle Swarm optimisation for Evolving Deep Neural Networks for Image Classification by Evolving and Stacking Transferable Blocks Proceedings Article
In: pp. 1-8, 2020.
Self-adaptive 2D-3D ensemble of fully convolutional networks for medical image segmentation Proceedings Article
In: pp. 113131W, 2020.
Hardware/Software Co-Exploration of Neural Architectures Journal Article
In: vol. 39, no. 12, pp. 4805-4815, 2020.