Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2019
A Variational-Sequential Graph Autoencoder for Neural Architecture Performance Prediction Technical Report
2019.
STEERAGE - Synthesis of Neural Networks Using Architecture Search and Grow-and-Prune Methods Technical Report
2019.
Leveraging End-to-End Speech Recognition with Neural Architecture Search Technical Report
2019.
Efficient Differentiable Neural Architecture Search with Meta Kernels Technical Report
2019.
MetAdapt - Meta-Learned Task-Adaptive Architecture for Few-Shot Classification Technical Report
2019.
Blockwisely Supervised Neural Architecture Search with Knowledge Distillation Technical Report
2019.
Artificial Neural Network and Accelerator Co-design using Evolutionary Algorithms Proceedings Article
In: pp. 1-8, 2019.
Auto-creation of Effective Neural Network Architecture by Evolutionary Algorithm and ResNet for Image Classification Proceedings Article
In: pp. 3895-3900, 2019.
EDAS - Efficient and Differentiable Architecture Search Technical Report
2019.
Ranking architectures using meta-learning Technical Report
2019.
Exploiting Operation Importance for Differentiable Neural Architecture Search Technical Report
2019.
Multi-objective Neural Architecture Search via Predictive Network Performance Optimization Technical Report
2019.
Data Proxy Generation for Fast and Efficient Neural Architecture Search Technical Report
2019.
ImmuNeCS - Neural Committee Search by an Artificial Immune System Technical Report
2019.
NAIS - Neural Architecture and Implementation Search and its Applications in Autonomous Driving Proceedings Article
In: pp. 1-8, 2019.
Neural Recurrent Structure Search for Knowledge Graph Embedding Technical Report
2019.
AutoPrune - Automatic Network Pruning by Regularizing Auxiliary Parameters Proceedings Article
In: pp. 13681-13691, 2019.
DATA - Differentiable ArchiTecture Approximation Proceedings Article
In: pp. 874-884, 2019.
Scalable reinforcement-learning-based neural architecture search for cancer deep learning research Proceedings Article
In: pp. 37:1-37:33, 2019.
Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition Proceedings Article
In: pp. 3583-3588, 2019.
Device-Circuit-Architecture Co-Exploration for Computing-in-Memory Neural Accelerators Technical Report
2019.
On Neural Architecture Search for Resource-Constrained Hardware Platforms Technical Report
2019.
NAT - Neural Architecture Transformer for Accurate and Compact Architectures Proceedings Article
In: pp. 735-747, 2019.
Deep neural network architecture search using network morphism Proceedings Article
In: pp. 30-35, 2019.
Person Re-identification with Neural Architecture Search Proceedings Article
In: pp. 540-551, 2019.
Resource Constrained Neural Network Architecture Search - Will a Submodularity Assumption Help? Proceedings Article
In: pp. 1901-1910, 2019.
Auto-FPN - Automatic Network Architecture Adaptation for Object Detection Beyond Classification Proceedings Article
In: pp. 6648-6657, 2019.
BANANAS - Bayesian Optimization with Neural Architectures for Neural Architecture Search Technical Report
2019.
Stabilizing DARTS with Amended Gradient Estimation on Architectural Parameters Technical Report
2019.
Fast Task-Aware Architecture Inference Technical Report
2019.
Efficient Structured Pruning and Architecture Searching for Group Convolution Proceedings Article
In: pp. 1961-1970, 2019.
On-Device Image Classification with Proxyless Neural Architecture Search and Quantization-Aware Fine-Tuning Proceedings Article
In: pp. 2509-2513, 2019.
MSNet - Structural Wired Neural Architecture Search for Internet of Things Proceedings Article
In: pp. 2033-2036, 2019.
Using Neural Architecture Search to Optimize Neural Networks for Embedded Devices Proceedings Article
In: pp. 684-693, 2019.
NASIB - Neural Architecture Search withIn Budget Technical Report
2019.
State of Compact Architecture Search For Deep Neural Networks Technical Report
2019.
One-Shot Neural Architecture Search via Self-Evaluated Template Network Proceedings Article
In: pp. 3680-3689, 2019.
Scalable Neural Architecture Search for 3D Medical Image Segmentation Proceedings Article
In: pp. 220-228, 2019.
Neural Architecture Search for Adversarial Medical Image Segmentation Proceedings Article
In: pp. 828-836, 2019.
Identify Hierarchical Structures from Task-Based fMRI Data via Hybrid Spatiotemporal Neural Architecture Search Net Proceedings Article
In: pp. 745-753, 2019.
Energy-Aware Neural Architecture Optimization with Fast Splitting Steepest Descent Technical Report
2019.
Improving One-shot NAS by Suppressing the Posterior Fading Technical Report
2019.
Splitting Steepest Descent for Growing Neural Architectures Proceedings Article
In: pp. 10655-10665, 2019.
A Novel Automatic CNN Architecture Design Approach Based on Genetic Algorithm Proceedings Article
In: pp. 473-482, 2019.
RNAS - Architecture Ranking for Powerful Networks Technical Report
2019.
Towards Unifying Neural Architecture Space Exploration and Generalization Technical Report
2019.
Sub-Architecture Ensemble Pruning in Neural Architecture Search Technical Report
2019.
Towards modular and programmable architecture search Proceedings Article
In: pp. 13715-13725, 2019.