Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2019
Tabular Benchmarks for Joint Architecture and Hyperparameter Optimization Technical Report
2019.
BayesNAS - A Bayesian Approach for Neural Architecture Search Proceedings Article
In: pp. 7603-7613, 2019.
Single-Path NAS - Device-Aware Efficient ConvNet Design Technical Report
2019.
Automatic Design of Artificial Neural Networks for Gamma-Ray Detection Journal Article
In: vol. 7, pp. 110531-110540, 2019.
Neural Architecture Refinement - A Practical Way for Avoiding Overfitting in NAS Technical Report
2019.
Fast and reliable architecture selection for convolutional neural networks Proceedings Article
In: 2019.
Differentiable Architecture Search with Ensemble Gumbel-Softmax Technical Report
2019.
Searching for a Robust Neural Architecture in Four GPU Hours Proceedings Article
In: pp. 1761-1770, 2019.
Evolving Unsupervised Deep Neural Networks for Learning Meaningful Representations Journal Article
In: vol. 23, no. 1, pp. 89-103, 2019.
Automatic Design of Convolutional Neural Network for Hyperspectral Image Classification Journal Article
In: vol. 57, no. 9, pp. 7048-7066, 2019.
Progressive Differentiable Architecture Search - Bridging the Depth Gap Between Search and Evaluation Proceedings Article
In: pp. 1294-1303, 2019.
Design Automation for Efficient Deep Learning Computing Technical Report
2019.
CascadeML - An Automatic Neural Network Architecture Evolution and Training Algorithm for Multi-label Classification (Best Technical Paper) Proceedings Article
In: pp. 3-17, 2019.
GraphNAS - Graph Neural Architecture Search with Reinforcement Learning Technical Report
2019.
Efficient Neural Architecture Search on Low-Dimensional Data for OCT Image Segmentation Technical Report
2019.
NAS-Unet - Neural Architecture Search for Medical Image Segmentation Journal Article
In: vol. 7, pp. 44247-44257, 2019.
Fast DENSER - Efficient Deep NeuroEvolution Proceedings Article
In: pp. 197-212, 2019.
NAS-FPN - Learning Scalable Feature Pyramid Architecture for Object Detection Proceedings Article
In: pp. 7036-7045, 2019.
Automated Search for Configurations of Deep Neural Network Architectures Technical Report
2019.
WeNet - Weighted Networks for Recurrent Network Architecture Search Technical Report
2019.
Size/Accuracy Trade-Off in Convolutional Neural Networks - An Evolutionary Approach Proceedings Article
In: pp. 17-26, 2019.
Single-Path NAS - Designing Hardware-Efficient ConvNets in Less Than 4 Hours Proceedings Article
In: pp. 481-497, 2019.
Exploring Randomly Wired Neural Networks for Image Recognition Proceedings Article
In: pp. 1284-1293, 2019.
Understanding Neural Architecture Search Techniques Technical Report
2019.
Automatic Convolutional Neural Architecture Search for Image Classification Under Different Scenes Journal Article
In: vol. 7, pp. 38495-38506, 2019.
sharpDARTS - Faster and More Accurate Differentiable Architecture Search Technical Report
2019.
DetNAS - Neural Architecture Search on Object Detection Technical Report
2019.
Deep Evolutionary Networks with Expedited Genetic Algorithms for Medical Image Denoising Journal Article
In: vol. 54, pp. 306-315, 2019.
AttoNets - Compact and Efficient Deep Neural Networks for the Edge via Human-Machine Collaborative Design Proceedings Article
In: pp. 684-693, 2019.
Improving Neural Architecture Search Image Classifiers via Ensemble Learning Technical Report
2019.
Software-Defined Design Space Exploration for an Efficient AI Accelerator Architecture Technical Report
2019.
MFAS - Multimodal Fusion Architecture Search Proceedings Article
In: pp. 6966-6975, 2019.
A Hybrid GA-PSO Method for Evolving Architecture and Short Connections of Deep Convolutional Neural Networks Proceedings Article
In: pp. 650-663, 2019.
Partial Order Pruning - For Best Speed/Accuracy Trade-Off in Neural Architecture Search Proceedings Article
In: pp. 9145-9153, 2019.
Inductive Transfer for Neural Architecture Optimization Technical Report
2019.
Evolutionary Cell Aided Design for Neural Network Architectures Technical Report
2019.
Automated Architecture-Modeling for Convolutional Neural Networks Proceedings Article
In: pp. 163-172, 2019.
Learning Implicitly Recurrent CNNs Through Parameter Sharing Proceedings Article
In: 2019.
Random Search and Reproducibility for Neural Architecture Search Proceedings Article
In: pp. 367-377, 2019.
Evolutionary neural AutoML for deep learning Proceedings Article
In: pp. 401-409, 2019.
Fast Task-Aware Architecture Inference Technical Report
2019.
Investigating recurrent neural network memory structures using neuro-evolution Proceedings Article
In: pp. 446-455, 2019.
Accuracy vs Efficiency - Achieving Both through FPGA-Implementation Aware Neural Architecture Search Proceedings Article
In: pp. 5, 2019.
The Evolved Transformer Proceedings Article
In: pp. 5877-5886, 2019.
Efficient training and design of photonic neural network through neuroevolution Technical Report
2019.
NeuNetS - An Automated Synthesis Engine for Neural Network Design Technical Report
2019.
Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Search Technical Report
2019.
Bayesian Learning of Neural Network Architectures Proceedings Article
In: pp. 730-738, 2019.