Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2020
NASABN - A Neural Architecture Search Framework for Attention-Based Networks Proceedings Article
In: pp. 1-7, 2020.
Att-DARTS - Differentiable Neural Architecture Search for Attention Proceedings Article
In: pp. 1-8, 2020.
Recurrent Neural Architecture Search based on Randomness-Enhanced Tabu Algorithm Proceedings Article
In: pp. 1-8, 2020.
MS-RANAS - Multi-Scale Resource-Aware Neural Architecture Search Technical Report
2020.
Disentangled Neural Architecture Search Technical Report
2020.
Visual Steering for One-Shot Deep Neural Network Synthesis Technical Report
2020.
Autokge: towards automated knowledge graph embedding Technical Report
2020.
Multi-Pass Transformer for Machine Translation Technical Report
2020.
AutoRC - Improving BERT Based Relation Classification Models via Architecture Search Technical Report
2020.
Evolutionary Architecture Search for Graph Neural Networks Technical Report
2020.
APNAS - Accuracy-and-Performance-Aware Neural Architecture Search for Neural Hardware Accelerators Journal Article
In: vol. 8, pp. 165319-165334, 2020.
Learned Low Precision Graph Neural Networks Technical Report
2020.
Neural Architecture Search Using Stable Rank of Convolutional Layers Technical Report
2020.
ENAS4D - Efficient Multi-stage CNN Architecture Search for Dynamic Inference Technical Report
2020.
Building NAS: Automatic designation of efficient neural architectures for building extraction in high-resolution aerial images Technical Report
2020, ISSN: 0262-8856.
Generating Efficient DNN-Ensembles with Evolutionary Computation Technical Report
2020.
Searching for Low-Bit Weights in Quantized Neural Networks Proceedings Article
In: 2020.
Evolutionary NAS with Gene Expression Programming of Cellular Encoding Technical Report
2020.
UXNet - Searching Multi-level Feature Aggregation for 3D Medical Image Segmentation Proceedings Article
In: pp. 346-356, 2020.
DANCE - Differentiable Accelerator/Network Co-Exploration Technical Report
2020.
RelativeNAS - Relative Neural Architecture Search via Slow-Fast Learning Proceedings Article
In: 2020.
AutoML for Multilayer Perceptron and FPGA Co-design Technical Report
2020.
From Federated Learning to Federated Neural Architecture Search - A Survey Technical Report
2020.
Disentangling Neural Architectures and Weights - A Case Study in Supervised Classification Technical Report
2020.
Optimizing Convolutional Neural Network Architecture via Information Field Technical Report
2020.
Binarized Neural Architecture Search for Efficient Object Recognition Technical Report
2020.
Calibrationless MRI Reconstruction with a Plug-in Denoiser Technical Report
2020.
AutoKWS - Keyword Spotting with Differentiable Architecture Search Technical Report
2020.
Are Deep Neural Architectures Losing Information? Invertibility is Indispensable Proceedings Article
In: pp. 172-184, 2020.
AutoTrans - Automating Transformer Design via Reinforced Architecture Search Technical Report
2020.
S3NAS - Fast NPU-aware Neural Architecture Search Methodology Technical Report
2020.
Adversarially Robust Neural Architectures Technical Report
2020.
Quantum-Inspired Evolutionary Algorithm for Convolutional Neural Networks Architecture Search Proceedings Article
In: pp. 1-8, 2020.
Improving Deep Learning based Optical Character Recognition via Neural Architecture Search Proceedings Article
In: pp. 1-7, 2020.
NATS-Bench - Benchmarking NAS algorithms for Architecture Topology and Size Technical Report
2020.
Boosting share routing for multi-task learning Technical Report
2020.
MNET: Fruit Lesion Classification Convnet Design via Efficient Neural Architecture Search Technical Report
2020.
DATA: Differentiable ArchiTecture Approximation with Distribution Guided Sampling Technical Report
2020.
Scaling Up Deep Neural Network Optimization for Edge Inference Technical Report
2020.
Understanding the wiring evolution in differentiable neural architecture search Technical Report
2020.
Neural Architecture Search for Keyword Spotting Proceedings Article
In: pp. 1982-1986, 2020.
AutoDLCon - An Approach for Controlling the Automated Tuning for Deep Learning Networks Proceedings Article
In: pp. 157-164, 2020.
AutoGesNet: Auto Gesture Recognition Network Based on Neural Architecture Search Technical Report
2020.
Graph Neural Network Architecture Search for Molecular Property Prediction Technical Report
2020.
NASirt - AutoML based learning with instance-level complexity information Technical Report
2020.