Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
2021
HSCoNAS: Hardware-Software Co-Design of Efficient DNNs via Neural Architecture Search Technical Report
2021.
Rethinking Architecture Selection in Differentiable NAS Proceedings Article
In: International Conference on Learning Representations, 2021.
Searching by Generating: Flexible and Efficient One-Shot NAS with Architecture Generator Technical Report
2021.
Use of static surrogates in hyperparameter optimization Technical Report
2021.
The Untapped Potential of Off-the-Shelf Convolutional Neural Networks Technical Report
2021.
SNAP: Shaping neural architectures progressively via information density criterion Journal Article
In: Pattern Recognition, vol. 116, pp. 107923, 2021, ISSN: 0031-3203.
HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark Proceedings Article
In: ICLR 2021, 2021.
SEDONA: Search for Decoupled Neural Networks toward Greedy Block-wise Learning Proceedings Article
In: International Conference on Learning Representations, 2021.
Meta-learning Symmetries by Reparameterization Proceedings Article
In: International Conference on Learning Representations, 2021.
NAS-Bench-ASR: Reproducible Neural Architecture Search for Speech Recognition Proceedings Article
In: International Conference on Learning Representations, 2021.
AutoSpace: Neural Architecture Search with Less Human Interference Technical Report
2021.
Efficient Neural Architecture Search for Long Short-Term Memory Networks Proceedings Article
In: 2021 IEEE 19th World Symposium on Applied Machine Intelligence and Informatics (SAMI), pp. 000287-000292, 2021.
GNAS: A Generalized Neural Network Architecture Search Framework Technical Report
2021.
Enhanced Gradient for Differentiable Architecture Search Technical Report
2021.
Prioritized Architecture Sampling with Monto-Carlo Tree Search Technical Report
2021.
Steganalysis of convolutional neural network based on neural architecture search Journal Article
In: Multimedia Systems, 2021.
MANAS: Multi-Scale and Multi-Level Neural Architecture Search for Low-Dose CT Denoising Journal Article
In: CoRR, vol. abs/2103.12995, 2021.
2D and 3D Palmprint and Palm Vein Recognition Based on Neural Architecture Search Journal Article
In: International Journal of Automation and Computing, no. IJAC-2021-01-01, pp. 1, 2021, ISSN: 1476-8186.
ModularNAS: Towards Modularized and Reusable Neural Architecture Search Proceedings Article
In: Proceedings of Machine Learning and Systems 3 pre-proceedings (MLSys 2021), 2021.
EfficientTDNN: Efficient Architecture Search for Speaker Recognition in the Wild Technical Report
2021.
Local Search is a Remarkably Strong Baseline for Neural Architecture Search Proceedings Article
In: Ishibuchi, Hisao; Zhang, Qingfu; Cheng, Ran; Li, Ke; Li, Hui; Wang, Handing; Zhou, Aimin (Ed.): Evolutionary Multi-Criterion Optimization - 11th International Conference, EMO 2021, Shenzhen, China, March 28-31, 2021, Proceedings, pp. 465–479, Springer, 2021.
Learning Versatile Neural Architectures by Propagating Network Codes Technical Report
2021.
Open-Source Neural Architecture Search with Ensemble and Pre-trained Networks Journal Article
In: International Journal of Modeling and Optimization, vol. 11, no. 2, pp. 33-41, 2021.
One-shot Graph Neural Architecture Search with Dynamic Search Space Proceedings Article
In: AAAI 2021, 2021.
Rethinking Graph Neural Network Search from Message-passing Technical Report
2021.
Rethinking Neural Operations for Diverse Tasks Technical Report
2021.
DiNTS: Differentiable Neural Network Topology Search for 3D Medical Image Segmentation Technical Report
2021.
Self-Constructing Neural Networks Through Random Mutation Technical Report
2021.
Differentiable Network Adaption with Elastic Search Space Technical Report
2021.
A resource-efficient method for repeated HPO and NAS problems Technical Report
2021.
A Linear NAS Service of ConvNets for Fast Deployment in the Edge of 5G Networks Journal Article
In: IEEE Network, vol. 35, no. 2, pp. 46-52, 2021.
Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets Proceedings Article
In: International Conference on Learning Representations, 2021.
BNAS: Efficient Neural Architecture Search Using Broad Scalable Architecture Journal Article
In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-15, 2021.
Neural Architecture Search For LF-MMI Trained Time Delay Neural Networks Proceedings Article
In: ICASSP2021, 2021.
Evolutionary Algorithm-Based and Network Architecture Search-Enabled Multiobjective Traffic Classification Journal Article
In: IEEE Access, vol. 9, pp. 52310-52325, 2021.
Joint Learning of Neural Transfer and Architecture Adaptation for Image Recognition Journal Article
In: IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021.
BioNetExplorer: Architecture-Space Exploration of Bio-Signal Processing Deep Neural Networks for Wearables Journal Article
In: IEEE Internet of Things Journal, pp. 1-1, 2021.
EfficientNetV2: Smaller Models and Faster Training Technical Report
2021.
An Efficient Hardware Design for Accelerating Sparse CNNs with NAS-based Models Journal Article
In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2021.
Continuous Ant-Based Neural Topology Search Proceedings Article
In: Castillo, Pedro A.; Laredo, Juan Luis Jim'enez (Ed.): Applications of Evolutionary Computation: 24th International Conference, EvoApplications 2021, Held as Part of EvoStar 2021, Virtual Event, April 7--9, 2021, Proceedings, pp. 291, Springer Nature 2021.
How Powerful are Performance Predictors in Neural Architecture Search? Technical Report
2021.
NAS-TC: Neural Architecture Search on Temporal Convolutions for Complex Action Recognition Technical Report
2021.
Subject Sensitive EEG Discrimination with Fast Reconstructable CNN Driven by Reinforcement Learning: A Case Study of ASD Evaluation Journal Article
In: Neurocomputing, 2021, ISSN: 0925-2312.
Automating Generative Adversarial Networks using Neural Architecture Search: A Review Proceedings Article
In: 2021 International Conference on Emerging Smart Computing and Informatics (ESCI), pp. 577-582, 2021.
Graph Convolutional Networks by Architecture Search for PolSAR Image Classification Journal Article
In: Remote Sensing, vol. 13, no. 7, 2021, ISSN: 2072-4292.
Partially-Connected Differentiable Architecture Search for Deepfake and Spoofing Detection Technical Report
2021.
Landmark Regularization: Ranking Guided Super-Net Training in Neural Architecture Search Technical Report
2021.