Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2019
CascadeML - An Automatic Neural Network Architecture Evolution and Training Algorithm for Multi-label Classification (Best Technical Paper) Proceedings Article
In: pp. 3-17, 2019.
GraphNAS - Graph Neural Architecture Search with Reinforcement Learning Technical Report
2019.
Efficient Neural Architecture Search on Low-Dimensional Data for OCT Image Segmentation Technical Report
2019.
NAS-Unet - Neural Architecture Search for Medical Image Segmentation Journal Article
In: vol. 7, pp. 44247-44257, 2019.
Fast DENSER - Efficient Deep NeuroEvolution Proceedings Article
In: pp. 197-212, 2019.
NAS-FPN - Learning Scalable Feature Pyramid Architecture for Object Detection Proceedings Article
In: pp. 7036-7045, 2019.
Automated Search for Configurations of Deep Neural Network Architectures Technical Report
2019.
WeNet - Weighted Networks for Recurrent Network Architecture Search Technical Report
2019.
Size/Accuracy Trade-Off in Convolutional Neural Networks - An Evolutionary Approach Proceedings Article
In: pp. 17-26, 2019.
Single-Path NAS - Designing Hardware-Efficient ConvNets in Less Than 4 Hours Proceedings Article
In: pp. 481-497, 2019.
Exploring Randomly Wired Neural Networks for Image Recognition Proceedings Article
In: pp. 1284-1293, 2019.
Understanding Neural Architecture Search Techniques Technical Report
2019.
Automatic Convolutional Neural Architecture Search for Image Classification Under Different Scenes Journal Article
In: vol. 7, pp. 38495-38506, 2019.
sharpDARTS - Faster and More Accurate Differentiable Architecture Search Technical Report
2019.
DetNAS - Neural Architecture Search on Object Detection Technical Report
2019.
Deep Evolutionary Networks with Expedited Genetic Algorithms for Medical Image Denoising Journal Article
In: vol. 54, pp. 306-315, 2019.
AttoNets - Compact and Efficient Deep Neural Networks for the Edge via Human-Machine Collaborative Design Proceedings Article
In: pp. 684-693, 2019.
Improving Neural Architecture Search Image Classifiers via Ensemble Learning Technical Report
2019.
Software-Defined Design Space Exploration for an Efficient AI Accelerator Architecture Technical Report
2019.
MFAS - Multimodal Fusion Architecture Search Proceedings Article
In: pp. 6966-6975, 2019.
A Hybrid GA-PSO Method for Evolving Architecture and Short Connections of Deep Convolutional Neural Networks Proceedings Article
In: pp. 650-663, 2019.
Partial Order Pruning - For Best Speed/Accuracy Trade-Off in Neural Architecture Search Proceedings Article
In: pp. 9145-9153, 2019.
Inductive Transfer for Neural Architecture Optimization Technical Report
2019.
Evolutionary Cell Aided Design for Neural Network Architectures Technical Report
2019.
Automated Architecture-Modeling for Convolutional Neural Networks Proceedings Article
In: pp. 163-172, 2019.
Learning Implicitly Recurrent CNNs Through Parameter Sharing Proceedings Article
In: 2019.
Random Search and Reproducibility for Neural Architecture Search Proceedings Article
In: pp. 367-377, 2019.
Evolutionary neural AutoML for deep learning Proceedings Article
In: pp. 401-409, 2019.
Fast Task-Aware Architecture Inference Technical Report
2019.
Investigating recurrent neural network memory structures using neuro-evolution Proceedings Article
In: pp. 446-455, 2019.
Accuracy vs Efficiency - Achieving Both through FPGA-Implementation Aware Neural Architecture Search Proceedings Article
In: pp. 5, 2019.
The Evolved Transformer Proceedings Article
In: pp. 5877-5886, 2019.
Efficient training and design of photonic neural network through neuroevolution Technical Report
2019.
NeuNetS - An Automated Synthesis Engine for Neural Network Design Technical Report
2019.
Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Search Technical Report
2019.
Bayesian Learning of Neural Network Architectures Proceedings Article
In: pp. 730-738, 2019.
Auto-DeepLab - Hierarchical Neural Architecture Search for Semantic Image Segmentation Proceedings Article
In: pp. 82-92, 2019.
The Art of Getting Deep Neural Networks in Shape Journal Article
In: vol. 15, no. 4, pp. 62:1-62:21, 2019.
SNAS - stochastic neural architecture search Proceedings Article
In: 2019.
Graph HyperNetworks for Neural Architecture Search Proceedings Article
In: 2019.
Efficient Multi-Objective Neural Architecture Search via Lamarckian Evolution Proceedings Article
In: 2019.
Pose Neural Fabrics Search Technical Report
2019.
ChamNet - Towards Efficient Network Design Through Platform-Aware Model Adaptation Proceedings Article
In: pp. 11398-11407, 2019.
Evolutionary Neural Architecture Search for Image Restoration Proceedings Article
In: pp. 1-8, 2019.
IRLAS - Inverse Reinforcement Learning for Architecture Search Proceedings Article
In: pp. 9021-9029, 2019.
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search Technical Report
2019.
ProxylessNAS - Direct Neural Architecture Search on Target Task and Hardware Proceedings Article
In: 2019.
TEA-DNN - the Quest for Time-Energy-Accuracy Co-optimized Deep Neural Networks Proceedings Article
In: pp. 1-6, 2019.