Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2020
Model Rubik's Cube: Twisting Resolution, Depth and Width for TinyNets Technical Report
2020.
DNA - Differentiable Network-Accelerator Co-Search Technical Report
2020.
Adaptation Strategies for Automated Machine Learning on Evolving Data Technical Report
2020.
Differentiable Neural Architecture Search in Equivalent Space with Exploration Enhancement Proceedings Article
In: 2020.
AutoST - Efficient Neural Architecture Search for Spatio-Temporal Prediction Proceedings Article
In: pp. 794-802, 2020.
Bird Species Recognition via Neural Architecture Search Proceedings Article
In: 2020.
Neural Architecture Search of SPD Manifold Networks Technical Report
2020.
Image Classification Based on Automatic Neural Architecture Search Using Binary Crow Search Algorithm Journal Article
In: vol. 8, pp. 189891-189912, 2020.
μNAS - Constrained Neural Architecture Search for Microcontrollers Technical Report
2020.
Task-Aware Neural Architecture Search Technical Report
2020.
Delta-STN - Efficient Bilevel Optimization for Neural Networks using Structured Response Jacobians Proceedings Article
In: 2020.
Hierarchical Neural Architecture Search for Deep Stereo Matching Proceedings Article
In: 2020.
AutoBSS - An Efficient Algorithm for Block Stacking Style Search Proceedings Article
In: 2020.
How to Train Your Super-Net - An Analysis of Training Heuristics in Weight-Sharing NAS Technical Report
2020.
DartsReNet - Exploring New RNN Cells in ReNet Architectures Proceedings Article
In: pp. 850-861, 2020.
AutoFeature - Searching for Feature Interactions and Their Architectures for Click-through Rate Prediction Proceedings Article
In: pp. 625-634, 2020.
Neural Architecture Performance Prediction Using Graph Neural Networks Technical Report
2020.
Neural Network Subgraphs Correlation with Trained Model Accuracy Proceedings Article
In: pp. 271-279, 2020.
Multi-objective Cuckoo Algorithm for Mobile Devices Network Architecture Search Proceedings Article
In: pp. 312-324, 2020.
Multiobjective Evolution for Convolutional Neural Network Architecture Search Proceedings Article
In: pp. 261-270, 2020.
G-DARTS-A - Groups of Channel Parallel Sampling with Attention Technical Report
2020.
How Does Supernet Help in Neural Architecture Search? Technical Report
2020.
Pre-defined Sparsity for Low-Complexity Convolutional Neural Networks Technical Report
2020.
SharedNet - A Novel Efficient Convolutional Architecture Based on Group Sharing Convolution Proceedings Article
In: pp. 128-139, 2020.
A Novel Multi-class Classification Framework Based on Local OVR Deep Neural Network Proceedings Article
In: pp. 48:1-48:6, 2020.
D-GHNAS for Joint Intent Classification and Slot Filling Proceedings Article
In: pp. 794-807, 2020.
AutoADR - Automatic Model Design for Ad Relevance Proceedings Article
In: pp. 2365-2372, 2020.
Improving FIFA Player Agents Decision-Making Architectures Based on Convolutional Neural Networks Through Evolutionary Techniques Proceedings Article
In: pp. 371-386, 2020.
E-DNAS: Differentiable Neural Architecture Search for Embedded Systems Technical Report
2020.
SAR-NAS - Skeleton-based action recognition via neural architecture searching Journal Article
In: vol. 73, pp. 102942, 2020.
K-armed Bandit based Multi-Modal Network Architecture Search for Visual Question Answering Proceedings Article
In: pp. 1245-1254, 2020.
Direct Federated Neural Architecture Search Technical Report
2020.
ISTA-NAS - Efficient and Consistent Neural Architecture Search by Sparse Coding Proceedings Article
In: 2020.
Multi-path Neural Networks for On-device Multi-domain Visual Classification Technical Report
2020.
Smooth Variational Graph Embeddings for Efficient Neural Architecture Search Technical Report
2020.
Once Quantized for All - Progressively Searching for Quantized Efficient Models Technical Report
2020.
Evolved Speech-Transformer - Applying Neural Architecture Search to End-to-End Automatic Speech Recognition Proceedings Article
In: pp. 1788-1792, 2020.
Pose-native Network Architecture Search for Multi-person Human Pose Estimation Proceedings Article
In: pp. 592-600, 2020.
VONAS - Network Design in Visual Odometry using Neural Architecture Search Proceedings Article
In: pp. 727-735, 2020.
Evaluating the Effectiveness of Efficient Neural Architecture Search for Sentence-Pair Tasks Proceedings Article
In: pp. 22-31, 2020.
Single Path One-Shot Neural Architecture Search with Uniform Sampling Proceedings Article
In: pp. 544-560, 2020.
PD-DARTS - Progressive Discretization Differentiable Architecture Search Proceedings Article
In: pp. 306-311, 2020.
Propagation Model Search for Graph Neural Networks Technical Report
2020.
An Accurate CNN Architecture For Atrial Fibrillation Detection Using Neural Architecture Search Proceedings Article
In: pp. 1135-1139, 2020.
AutoCLINT: The Winning Method in AutoCV Challenge 2019 Technical Report
2020.
Shape Adaptor - A Learnable Resizing Module Proceedings Article
In: pp. 661-677, 2020.