Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2020
PONAS - Progressive One-shot Neural Architecture Search for Very Efficient Deployment Technical Report
2020.
Hierarchical Neural Architecture Search for Single Image Super-Resolution Journal Article
In: vol. 27, pp. 1255-1259, 2020.
How to Train Your Super-Net - An Analysis of Training Heuristics in Weight-Sharing NAS Technical Report
2020.
AutoML-Zero - Evolving Machine Learning Algorithms From Scratch Proceedings Article
In: pp. 8007-8019, 2020.
Accelerator-aware Neural Network Design using AutoML Technical Report
2020.
Real-time Federated Evolutionary Neural Architecture Search Technical Report
2020.
BATS - Binary ArchitecTure Search Proceedings Article
In: pp. 309-325, 2020.
ADWPNAS - Architecture-Driven Weight Prediction for Neural Architecture Search Technical Report
2020.
NAS-Count - Counting-by-Density with Neural Architecture Search Proceedings Article
In: pp. 747-766, 2020.
Neural Inheritance Relation Guided One-Shot Layer Assignment Search Proceedings Article
In: pp. 5158-5165, 2020.
Automatically Searching for U-Net Image Translator Architecture Technical Report
2020.
AutoEmb - Automated Embedding Dimensionality Search in Streaming Recommendations Technical Report
2020.
Memory-Efficient Models for Scene Text Recognition via Neural Architecture Search Proceedings Article
In: pp. 183-191, 2020.
Searching for Winograd-aware Quantized Networks Proceedings Article
In: 2020.
Semi-Supervised Neural Architecture Search Proceedings Article
In: 2020.
Neural Architecture Search for compressed sensing Magnetic Resonance image reconstruction Journal Article
In: vol. 85, pp. 101784, 2020.
DSNAS - Direct Neural Architecture Search Without Parameter Retraining Proceedings Article
In: pp. 12081-12089, 2020.
Neural Architecture Search For Fault Diagnosis Technical Report
2020.
Learning Architectures for Binary Networks Proceedings Article
In: pp. 575-591, 2020.
Neural Architecture Search over Decentralized Data Technical Report
2020.
Automatic Structural Search for Multi-task Learning VALPs Proceedings Article
In: pp. 25-36, 2020.
RandomNet - Towards Fully Automatic Neural Architecture Design for Multimodal Learning Technical Report
2020.
Classifying the Classifier - Dissecting the Weight Space of Neural Networks Proceedings Article
In: pp. 1119-1126, 2020.
Stabilizing Differentiable Architecture Search via Perturbation-based Regularization Proceedings Article
In: pp. 1554-1565, 2020.
Best of Both Worlds - AutoML Codesign of a CNN and its Hardware Accelerator Proceedings Article
In: pp. 1-6, 2020.
Variational Depth Search in ResNets Technical Report
2020.
Co-Exploration of Neural Architectures and Heterogeneous ASIC Accelerator Designs Targeting Multiple Tasks Proceedings Article
In: pp. 1-6, 2020.
AutoFCL - Automatically Tuning Fully Connected Layers for Transfer Learning Technical Report
2020.
NASS - Optimizing Secure Inference via Neural Architecture Search Proceedings Article
In: pp. 1746-1753, 2020.
Search for Better Students to Learn Distilled Knowledge Proceedings Article
In: pp. 1159-1165, 2020.
Bayesian Neural Architecture Search using A Training-Free Performance Metric Technical Report
2020.
NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Technical Report
2020.
Convolution Neural Network Architecture Learning for Remote Sensing Scene Classification Technical Report
2020.
Multi-objective Neural Architecture Search via Non-stationary Policy Gradient Technical Report
2020.
Efficient Neural Architecture Search - A Broad Version Technical Report
2020.
ENAS U-Net - Evolutionary Neural Architecture Search for Retinal Vessel Segmentation Technical Report
2020.
FlexiBO - Cost-Aware Multi-Objective Optimization of Deep Neural Networks Technical Report
2020.
Latency-Aware Differentiable Neural Architecture Search Technical Report
2020.
MixPath - A Unified Approach for One-shot Neural Architecture Search Technical Report
2020.
Neural Architecture Search for Skin Lesion Classification Journal Article
In: vol. 8, pp. 9061-9071, 2020.
AdaBERT - Task-Adaptive BERT Compression with Differentiable Neural Architecture Search Proceedings Article
In: pp. 2463-2469, 2020.
Neural Architecture Search for Deep Image Prior Technical Report
2020.
Fast Neural Network Adaptation via Parameter Remapping and Architecture Search Proceedings Article
In: 2020.
FTT-NAS - Discovering Fault-Tolerant Neural Architecture Proceedings Article
In: pp. 211-216, 2020.
Deeper Insights into Weight Sharing in Neural Architecture Search Technical Report
2020.
EcoNAS - Finding Proxies for Economical Neural Architecture Search Proceedings Article
In: pp. 11393-11401, 2020.
DeepMaker - A multi-objective optimization framework for deep neural networks in embedded systems Journal Article
In: vol. 73, pp. 102989, 2020.
Auto-ORVNet - Orientation-Boosted Volumetric Neural Architecture Search for 3D Shape Classification Journal Article
In: vol. 8, pp. 12942-12954, 2020.