Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2020
Bonsai-Net - One-Shot Neural Architecture Search via Differentiable Pruners Technical Report
2020.
AlphaGAN - Fully Differentiable Architecture Search for Generative Adversarial Networks Technical Report
2020.
Fine-Tuning DARTS for Image Classification Technical Report
2020.
Neural Anisotropy Directions Proceedings Article
In: 2020.
CryptoNAS - Private Inference on a ReLU Budget Proceedings Article
In: 2020.
Heuristic Architecture Search Using Network Morphism for Chest X-Ray Classification Proceedings Article
In: pp. 107-121, 2020.
Task-Aware Performance Prediction for Efficient Architecture Search Proceedings Article
In: pp. 1238-1245, 2020.
Beyond Network Pruning - a Joint Search-and-Training Approach Proceedings Article
In: pp. 2583-2590, 2020.
Neural Ensemble Search for Performant and Calibrated Predictions Technical Report
2020.
Multi-fidelity Neural Architecture Search with Knowledge Distillation Technical Report
2020.
Inner Ensemble Networks: Average Ensemble as an Effective Regularizer Technical Report
2020.
Differentiable Neural Architecture Transformation for Reproducible Architecture Improvement Technical Report
2020.
Neural Architecture Search using Bayesian Optimisation with Weisfeiler-Lehman Kernel Technical Report
2020.
NAS-Bench-NLP - Neural Architecture Search Benchmark for Natural Language Processing Technical Report
2020.
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Proceedings Article
In: 2020.
Few-shot Neural Architecture Search Technical Report
2020.
NADS - Neural Architecture Distribution Search for Uncertainty Awareness Proceedings Article
In: pp. 356-366, 2020.
AMER - Automatic Behavior Modeling and Interaction Exploration in Recommender System Technical Report
2020.
Neuroevolution in Deep Neural Networks - Current Trends and Future Challenges Technical Report
2020.
AutoGAN-Distiller - Searching to Compress Generative Adversarial Networks Proceedings Article
In: pp. 3292-3303, 2020.
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Proceedings Article
In: 2020.
Hardware-Aware Transformable Architecture Search with Efficient Search Space Proceedings Article
In: pp. 1-6, 2020.
Auto-Generating Neural Networks with Reinforcement Learning for Multi-Purpose Image Forensics Proceedings Article
In: pp. 1-6, 2020.
Neural Architecture Search without Training Technical Report
2020.
Differentiable Neural Input Search for Recommender Systems Technical Report
2020.
Efficient Architecture Search for Continual Learning Technical Report
2020.
Conditional Neural Architecture Search Technical Report
2020.
AutoHAS - Differentiable Hyper-parameter and Architecture Search Technical Report
2020.
Modeling task-based fMRI data via deep belief network with neural architecture search Journal Article
In: vol. 83, pp. 101747, 2020.
Fast Hardware-Aware Neural Architecture Search Proceedings Article
In: pp. 2959-2967, 2020.
Memory-Efficient Hierarchical Neural Architecture Search for Image Denoising Proceedings Article
In: pp. 3654-3663, 2020.
GP-NAS - Gaussian Process Based Neural Architecture Search Proceedings Article
In: pp. 11930-11939, 2020.
MemNAS - Memory-Efficient Neural Architecture Search With Grow-Trim Learning Proceedings Article
In: pp. 2105-2113, 2020.
Can Weight Sharing Outperform Random Architecture Search? An Investigation With TuNAS Proceedings Article
In: pp. 14311-14320, 2020.
Butterfly Transform - An Efficient FFT Based Neural Architecture Design Proceedings Article
In: pp. 12021-12030, 2020.
APQ - Joint Search for Network Architecture, Pruning and Quantization Policy Proceedings Article
In: pp. 2075-2084, 2020.
SP-NAS - Serial-to-Parallel Backbone Search for Object Detection Proceedings Article
In: pp. 11860-11869, 2020.
All in One Bad Weather Removal Using Architectural Search Proceedings Article
In: pp. 3172-3182, 2020.
NeuralScale: Efficient Scaling of Neurons for Resource-Constrained Deep Neural Networks Technical Report
2020.
A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions Technical Report
2020.
FBNetV3 - Joint Architecture-Recipe Search using Neural Acquisition Function Technical Report
2020.
Automation of Deep Learning - Theory and Practice Proceedings Article
In: pp. 5-6, 2020.
AdaEn-Net - An ensemble of adaptive 2D-3D Fully Convolutional Networks for medical image segmentation Journal Article
In: vol. 126, pp. 76-94, 2020.
DC-NAS - Divide-and-Conquer Neural Architecture Search Technical Report
2020.
HourNAS - Extremely Fast Neural Architecture Search Through an Hourglass Lens Proceedings Article
In: CVPR 2021, 2020.
Designing resource-constrained neural networks using neural architecture search targeting embedded devices Journal Article
In: vol. 12, pp. 100234, 2020.
Searching Better Architectures for Neural Machine Translation Journal Article
In: vol. 28, pp. 1574-1585, 2020.