Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2020
Surrogate-Assisted Evolutionary Deep Learning Using an End-to-End Random Forest-Based Performance Predictor Journal Article
In: vol. 24, no. 2, pp. 350-364, 2020.
Densely Connected Search Space for More Flexible Neural Architecture Search Proceedings Article
In: pp. 10625-10634, 2020.
Posterior-Guided Neural Architecture Search Proceedings Article
In: pp. 6973-6980, 2020.
AutoGrow - Automatic Layer Growing in Deep Convolutional Networks Proceedings Article
In: pp. 833-841, 2020.
AssembleNet - Searching for Multi-Stream Neural Connectivity in Video Architectures Proceedings Article
In: 2020.
Constrained Design of Deep Iris Networks Journal Article
In: vol. 29, pp. 7166-7175, 2020.
Evolving Deep Convolutional Neural Networks for Image Classification Journal Article
In: vol. 24, no. 2, pp. 394-407, 2020.
AdaResU-Net - Multiobjective adaptive convolutional neural network for medical image segmentation Journal Article
In: vol. 392, pp. 325-340, 2020.
A New Deep Neural Architecture Search Pipeline for Face Recognition Journal Article
In: vol. 8, pp. 91303-91310, 2020.
Designing resource-constrained neural networks using neural architecture search targeting embedded devices Journal Article
In: vol. 12, pp. 100234, 2020.
ASAP - Architecture Search, Anneal and Prune Proceedings Article
In: pp. 493-503, 2020.
Architecture Search of Dynamic Cells for Semantic Video Segmentation Proceedings Article
In: pp. 1959-1968, 2020.
Template-Based Automatic Search of Compact Semantic Segmentation Architectures Proceedings Article
In: pp. 1969-1978, 2020.
Single Path One-Shot Neural Architecture Search with Uniform Sampling Proceedings Article
In: pp. 544-560, 2020.
Evolution of Deep Convolutional Neural Networks Using Cartesian Genetic Programming Journal Article
In: vol. 28, no. 1, pp. 141-163, 2020.
Tuning Hyperparameters without Grad Students - Scalable and Robust Bayesian Optimisation with Dragonfly Journal Article
In: vol. 21, pp. 81:1-81:27, 2020.
Evaluating The Search Phase of Neural Architecture Search Proceedings Article
In: 2020.
FP-NAS - Fast Probabilistic Neural Architecture Search Technical Report
2020.
Multi-objective Reinforced Evolution in Mobile Neural Architecture Search Proceedings Article
In: pp. 99-113, 2020.
InstaNAS - Instance-Aware Neural Architecture Search Proceedings Article
In: pp. 3577-3584, 2020.
Automatically Designing CNN Architectures Using the Genetic Algorithm for Image Classification Journal Article
In: vol. 50, no. 9, pp. 3840-3854, 2020.
PONAS - Progressive One-shot Neural Architecture Search for Very Efficient Deployment Technical Report
2020.
Fair DARTS - Eliminating Unfair Advantages in Differentiable Architecture Search Proceedings Article
In: pp. 465-480, 2020.
Neural Architecture Search Using Deep Neural Networks and Monte Carlo Tree Search Proceedings Article
In: pp. 9983-9991, 2020.
Search Tree Pruning for Progressive Neural Architecture Search (Student Abstract) Proceedings Article
In: pp. 13783-13784, 2020.
Evolving artificial neural networks with feedback Journal Article
In: vol. 123, pp. 153-162, 2020.
A view on automated neural graph topology generation and a viable direction of innovation Proceedings Article
In: 2020 19th RoEduNet Conference: Networking in Education and Research (RoEduNet), pp. 1-7, 2020.
NAS-HR: search of neural architecture for heart-rate estimation from face videos Proceedings Article
In: 2020.
NAS-FCOS: Fast Neural Architecture Search for Object Detection Proceedings Article
In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, pp. 11940–11948, IEEE, 2020.
Evolving Deep Convolutional Variational Autoencoders for Image Classification Journal Article
In: IEEE Transactions on Evolutionary Computation, pp. 1-1, 2020.
Pretraining Neural Architecture Search Controllers with Locality-based Self-Supervised Learning Proceedings Article
In: NeurIPS 2020 Workshop: Self-Supervised Learning - Theory and Practice, 2020.
AutoBSS: An Efficient Algorithm for Block Stacking Style Search Proceedings Article
In: Larochelle, Hugo; Ranzato, MarcÁurelio; Hadsell, Raia; -, Maria; -, Hsuan (Ed.): Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual, 2020.
RSSM-Net: Remote Sensing Image Scene Classification Based on Multi-Objective Neural Architecture Search Proceedings Article
In: IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium, pp. 1369-1372, 2020.
Self-organising Neural Network Hierarchy Proceedings Article
In: Gallagher, Marcus; Moustafa, Nour; Lakshika, Erandi (Ed.): AI 2020: Advances in Artificial Intelligence - 33rd Australasian Joint Conference, AI 2020, Canberra, ACT, Australia, November 29-30, 2020, Proceedings, pp. 359–370, Springer, 2020.
NASB: Neural Architecture Search for Binary Convolutional Neural Networks Proceedings Article
In: 2020 International Joint Conference on Neural Networks, IJCNN 2020, Glasgow, United Kingdom, July 19-24, 2020, pp. 1–8, IEEE, 2020.
2019
Countering adaptive network covert communication with dynamic wardens Technical Report
2019, ISSN: 0167-739X.
Context R-CNN: Long Term Temporal Context for Per-Camera Object Detection Technical Report
2019.
Bayesian Tensorized Neural Networks with Automatic Rank Selection Technical Report
2019.
Balanced One-shot Neural Architecture Optimization Technical Report
2019.
Dynamic Cell Structure via Recursive-Recurrent Neural Networks Technical Report
2019.
EPNAS: Efficient Progressive Neural Architecture Search Technical Report
2019.
Tiny Video Networks Technical Report
2019.
On Network Design Spaces for Visual Recognition Proceedings Article
In: pp. 1882-1890, 2019.
Genetic Network Architecture Search Technical Report
2019.
Taxonomy of Real Faults in Deep Learning Systems Technical Report
2019.
The Ant Swarm Neuro-Evolution Procedure for Optimizing Recurrent Networks Technical Report
2019.