Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2019
Transfer NAS - Knowledge Transfer between Search Spaces with Transformer Agents Technical Report
2019.
XNAS - Neural Architecture Search with Expert Advice Proceedings Article
In: pp. 1975-1985, 2019.
A Study of the Learning Progress in Neural Architecture Search Techniques Technical Report
2019.
Hardware Aware Neural Network Architectures using FbNet Technical Report
2019.
Sample-Efficient Neural Architecture Search by Learning Action Space Technical Report
2019.
C2FNAS: Coarse-to-Fine Neural Architecture Search for 3D Medical Image Segmentation Technical Report
2019.
Continual and Multi-Task Architecture Search Proceedings Article
In: pp. 1911-1922, 2019.
One-Shot Neural Architecture Search via Compressive Sensing Technical Report
2019.
V-NAS - Neural Architecture Search for Volumetric Medical Image Segmentation Proceedings Article
In: pp. 240-248, 2019.
Efficient Forward Architecture Search Proceedings Article
In: pp. 10122-10131, 2019.
Differentiable Neural Architecture Search via Proximal Iterations Technical Report
2019.
Dynamic Distribution Pruning for Efficient Network Architecture Search Technical Report
2019.
Particle swarm optimization of deep neural networks architectures for image classification Journal Article
In: vol. 49, pp. 62-74, 2019.
On Network Design Spaces for Visual Recognition Proceedings Article
In: pp. 1882-1890, 2019.
EfficientNet - Rethinking Model Scaling for Convolutional Neural Networks Proceedings Article
In: pp. 6105-6114, 2019.
Structure Learning for Neural Module Networks Proceedings Article
In: pp. 1-10, 2019.
SpArSe - Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers Proceedings Article
In: pp. 4978-4990, 2019.
Network Pruning via Transformable Architecture Search Proceedings Article
In: pp. 759-770, 2019.
DEEP-BO for Hyperparameter Optimization of Deep Networks Technical Report
2019.
Adaptive Stochastic Natural Gradient Method for One-Shot Neural Architecture Search Proceedings Article
In: pp. 171-180, 2019.
Multinomial Distribution Learning for Effective Neural Architecture Search Proceedings Article
In: pp. 1304-1313, 2019.
EENA - Efficient Evolution of Neural Architecture Proceedings Article
In: pp. 1891-1899, 2019.
DeepSwarm - Optimising Convolutional Neural Networks Using Swarm Intelligence Proceedings Article
In: pp. 119-130, 2019.
AutoDispNet - Improving Disparity Estimation With AutoML Proceedings Article
In: pp. 1812-1823, 2019.
Online Hyper-Parameter Learning for Auto-Augmentation Strategy Proceedings Article
In: pp. 6578-6587, 2019.
Regularized Evolutionary Algorithm for Dynamic Neural Topology Search Proceedings Article
In: pp. 219-230, 2019.
Deep Neural Architecture Search with Deep Graph Bayesian Optimization Proceedings Article
In: pp. 500-507, 2019.
Automatic Model Selection for Neural Networks Technical Report
2019.
Tabular Benchmarks for Joint Architecture and Hyperparameter Optimization Technical Report
2019.
BayesNAS - A Bayesian Approach for Neural Architecture Search Proceedings Article
In: pp. 7603-7613, 2019.
Single-Path NAS - Device-Aware Efficient ConvNet Design Technical Report
2019.
Automatic Design of Artificial Neural Networks for Gamma-Ray Detection Journal Article
In: vol. 7, pp. 110531-110540, 2019.
Neural Architecture Refinement - A Practical Way for Avoiding Overfitting in NAS Technical Report
2019.
Fast and reliable architecture selection for convolutional neural networks Proceedings Article
In: 2019.
Differentiable Architecture Search with Ensemble Gumbel-Softmax Technical Report
2019.
Searching for a Robust Neural Architecture in Four GPU Hours Proceedings Article
In: pp. 1761-1770, 2019.
Evolving Unsupervised Deep Neural Networks for Learning Meaningful Representations Journal Article
In: vol. 23, no. 1, pp. 89-103, 2019.
Automatic Design of Convolutional Neural Network for Hyperspectral Image Classification Journal Article
In: vol. 57, no. 9, pp. 7048-7066, 2019.
Progressive Differentiable Architecture Search - Bridging the Depth Gap Between Search and Evaluation Proceedings Article
In: pp. 1294-1303, 2019.
Design Automation for Efficient Deep Learning Computing Technical Report
2019.
CascadeML - An Automatic Neural Network Architecture Evolution and Training Algorithm for Multi-label Classification (Best Technical Paper) Proceedings Article
In: pp. 3-17, 2019.
GraphNAS - Graph Neural Architecture Search with Reinforcement Learning Technical Report
2019.
Efficient Neural Architecture Search on Low-Dimensional Data for OCT Image Segmentation Technical Report
2019.
NAS-Unet - Neural Architecture Search for Medical Image Segmentation Journal Article
In: vol. 7, pp. 44247-44257, 2019.
Fast DENSER - Efficient Deep NeuroEvolution Proceedings Article
In: pp. 197-212, 2019.
NAS-FPN - Learning Scalable Feature Pyramid Architecture for Object Detection Proceedings Article
In: pp. 7036-7045, 2019.
Automated Search for Configurations of Deep Neural Network Architectures Technical Report
2019.
WeNet - Weighted Networks for Recurrent Network Architecture Search Technical Report
2019.