Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2019
Taxonomy of Real Faults in Deep Learning Systems Technical Report
2019.
The Ant Swarm Neuro-Evolution Procedure for Optimizing Recurrent Networks Technical Report
2019.
Efficient Evolutionary Neural Architecture Search (NAS) by Modular Inheritable Crossover Proceedings Article
In: pp. 761-769, 2019.
Efficient Evolutionary Architecture Search for CNN Optimization on GTSRB Proceedings Article
In: pp. 56-61, 2019.
Automating Deep Neural Network Model Selection for Edge Inference Proceedings Article
In: pp. 184-193, 2019.
FPNet - Customized Convolutional Neural Network for FPGA Platforms Proceedings Article
In: pp. 399-402, 2019.
Scalable NAS with Factorizable Architectural Parameters Technical Report
2019.
Modeling Neural Architecture Search Methods for Deep Networks Technical Report
2019.
Searching for Stage-wise Neural Graphs In the Limit Technical Report
2019.
RC-DARTS - Resource Constrained Differentiable Architecture Search Technical Report
2019.
BETANAS - BalancEd TrAining and selective drop for Neural Architecture Search Technical Report
2019.
Progressive DARTS - Bridging the Optimization Gap for NAS in the Wild Technical Report
2019.
Neural Architecture Search for Optimizing Deep Belief Network Models of fMRI Data Proceedings Article
In: pp. 26-34, 2019.
Preventing Information Leakage with Neural Architecture Search Technical Report
2019.
DBSN: Measuring Uncertainty through Bayesian Learning of Deep Neural Network Structures Technical Report
2019.
A Variational-Sequential Graph Autoencoder for Neural Architecture Performance Prediction Technical Report
2019.
STEERAGE - Synthesis of Neural Networks Using Architecture Search and Grow-and-Prune Methods Technical Report
2019.
Leveraging End-to-End Speech Recognition with Neural Architecture Search Technical Report
2019.
Efficient Differentiable Neural Architecture Search with Meta Kernels Technical Report
2019.
MetAdapt - Meta-Learned Task-Adaptive Architecture for Few-Shot Classification Technical Report
2019.
Blockwisely Supervised Neural Architecture Search with Knowledge Distillation Technical Report
2019.
Artificial Neural Network and Accelerator Co-design using Evolutionary Algorithms Proceedings Article
In: pp. 1-8, 2019.
Auto-creation of Effective Neural Network Architecture by Evolutionary Algorithm and ResNet for Image Classification Proceedings Article
In: pp. 3895-3900, 2019.
EDAS - Efficient and Differentiable Architecture Search Technical Report
2019.
Ranking architectures using meta-learning Technical Report
2019.
Exploiting Operation Importance for Differentiable Neural Architecture Search Technical Report
2019.
Multi-objective Neural Architecture Search via Predictive Network Performance Optimization Technical Report
2019.
Data Proxy Generation for Fast and Efficient Neural Architecture Search Technical Report
2019.
ImmuNeCS - Neural Committee Search by an Artificial Immune System Technical Report
2019.
NAIS - Neural Architecture and Implementation Search and its Applications in Autonomous Driving Proceedings Article
In: pp. 1-8, 2019.
Neural Recurrent Structure Search for Knowledge Graph Embedding Technical Report
2019.
AutoPrune - Automatic Network Pruning by Regularizing Auxiliary Parameters Proceedings Article
In: pp. 13681-13691, 2019.
DATA - Differentiable ArchiTecture Approximation Proceedings Article
In: pp. 874-884, 2019.
Scalable reinforcement-learning-based neural architecture search for cancer deep learning research Proceedings Article
In: pp. 37:1-37:33, 2019.
Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition Proceedings Article
In: pp. 3583-3588, 2019.
Device-Circuit-Architecture Co-Exploration for Computing-in-Memory Neural Accelerators Technical Report
2019.
On Neural Architecture Search for Resource-Constrained Hardware Platforms Technical Report
2019.
NAT - Neural Architecture Transformer for Accurate and Compact Architectures Proceedings Article
In: pp. 735-747, 2019.
Deep neural network architecture search using network morphism Proceedings Article
In: pp. 30-35, 2019.
Person Re-identification with Neural Architecture Search Proceedings Article
In: pp. 540-551, 2019.
Resource Constrained Neural Network Architecture Search - Will a Submodularity Assumption Help? Proceedings Article
In: pp. 1901-1910, 2019.
Auto-FPN - Automatic Network Architecture Adaptation for Object Detection Beyond Classification Proceedings Article
In: pp. 6648-6657, 2019.
BANANAS - Bayesian Optimization with Neural Architectures for Neural Architecture Search Technical Report
2019.
Stabilizing DARTS with Amended Gradient Estimation on Architectural Parameters Technical Report
2019.
Fast Task-Aware Architecture Inference Technical Report
2019.
Efficient Structured Pruning and Architecture Searching for Group Convolution Proceedings Article
In: pp. 1961-1970, 2019.
On-Device Image Classification with Proxyless Neural Architecture Search and Quantization-Aware Fine-Tuning Proceedings Article
In: pp. 2509-2513, 2019.