Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2020
HyperFDA: A Bi-Level Optimization Approach to Neural Architecture Search and Hyperparameters' Optimization via Fractal Decomposition-Based Algorithm Technical Report
Cancún, Mexico, 2020, ISBN: 9781450371278.
Towards evolving robust neural architectures to defend from adversarial attacks Proceedings Article
In: pp. 135-136, 2020.
A first step toward incremental evolution of convolutional neural networks Proceedings Article
In: pp. 115-116, 2020.
Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search Technical Report
2020.
Journey Towards Tiny Perceptual Super-Resolution Proceedings Article
In: pp. 85-102, 2020.
Hyperparameter Optimization in Neural Networks via Structured Sparse Recovery Technical Report
2020.
GOLD-NAS - Gradual, One-Level, Differentiable Technical Report
2020.
Discretization-Aware Architecture Search Technical Report
2020.
Parametric machines - a fresh approach to architecture search Technical Report
2020.
Surrogate-assisted Particle Swarm Optimisation for Evolving Variable-length Transferable Blocks for Image Classification Journal Article
In: IEEE transactions on Neural Networks and Learning Systems, vol. abs/2007.01556, pp. 1-14, 2020.
M-NAS - Meta Neural Architecture Search Proceedings Article
In: pp. 6186-6193, 2020.
RSNet: The Search for Remote Sensing Deep Neural Networks in Recognition Tasks Technical Report
2020.
Theory-Inspired Path-Regularized Differential Network Architecture Search Proceedings Article
In: 2020.
The Heterogeneity Hypothesis - Finding Layer-Wise Dissimilated Network Architecture Technical Report
2020.
Traditional and accelerated gradient descent for neural architecture search Technical Report
2020.
AutoSNAP - Automatically Learning Neural Architectures for Instrument Pose Estimation Proceedings Article
In: pp. 375-384, 2020.
AutoST - Efficient Neural Architecture Search for Spatio-Temporal Prediction Proceedings Article
In: pp. 794-802, 2020.
Neural architecture search for sparse DenseNets with dynamic compression Proceedings Article
In: pp. 386-394, 2020.
Searching towards Class-Aware Generators for Conditional Generative Adversarial Networks Technical Report
2020.
Neural Architecture Design for GPU-Efficient Networks Technical Report
2020.
Equivalence in Deep Neural Networks via Conjugate Matrix Ensembles Technical Report
2020.
Auto-PyTorch Tabular - Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Technical Report
2020.
FNA++ - Fast Network Adaptation via Parameter Remapping and Architecture Search Technical Report
2020.
Neural networks adapting to datasets - learning network size and topology Technical Report
2020.
AutoOD - Automated Outlier Detection via Curiosity-guided Search and Self-imitation Learning Technical Report
2020.
Reinforcement Learning Aided Network Architecture Generation for JPEG Image Steganalysis Proceedings Article
In: pp. 23-32, 2020.
Neural Architecture Search for Time Series Classification Proceedings Article
In: pp. 1-8, 2020.
Cyclic Differentiable Architecture Search Technical Report
2020.
Differentially-private Federated Neural Architecture Search Technical Report
2020.
DrNAS - Dirichlet Neural Architecture Search Technical Report
2020.
Neural Architecture Optimization with Graph VAE Technical Report
2020.
Fine-Grained Stochastic Architecture Search Technical Report
2020.
Bonsai-Net - One-Shot Neural Architecture Search via Differentiable Pruners Technical Report
2020.
AlphaGAN - Fully Differentiable Architecture Search for Generative Adversarial Networks Technical Report
2020.
Fine-Tuning DARTS for Image Classification Technical Report
2020.
Neural Anisotropy Directions Proceedings Article
In: 2020.
CryptoNAS - Private Inference on a ReLU Budget Proceedings Article
In: 2020.
Heuristic Architecture Search Using Network Morphism for Chest X-Ray Classification Proceedings Article
In: pp. 107-121, 2020.
Task-Aware Performance Prediction for Efficient Architecture Search Proceedings Article
In: pp. 1238-1245, 2020.
Beyond Network Pruning - a Joint Search-and-Training Approach Proceedings Article
In: pp. 2583-2590, 2020.
Neural Ensemble Search for Performant and Calibrated Predictions Technical Report
2020.
Multi-fidelity Neural Architecture Search with Knowledge Distillation Technical Report
2020.
Inner Ensemble Networks: Average Ensemble as an Effective Regularizer Technical Report
2020.
Differentiable Neural Architecture Transformation for Reproducible Architecture Improvement Technical Report
2020.
Neural Architecture Search using Bayesian Optimisation with Weisfeiler-Lehman Kernel Technical Report
2020.
NAS-Bench-NLP - Neural Architecture Search Benchmark for Natural Language Processing Technical Report
2020.
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Proceedings Article
In: 2020.