Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2020
Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution Proceedings Article
In: pp. 685-702, 2020.
Growing Efficient Deep Networks by Structured Continuous Sparsification Technical Report
2020.
Fusion Mechanisms for Human Activity Recognition Using Automated Machine Learning Journal Article
In: vol. 8, pp. 143996-144014, 2020.
Searching Collaborative Agents for Multi-plane Localization in 3D Ultrasound Proceedings Article
In: pp. 553-562, 2020.
TF-NAS - Rethinking Three Search Freedoms of Latency-Constrained Differentiable Neural Architecture Search Proceedings Article
In: pp. 123-139, 2020.
Efficient Oct Image Segmentation Using Neural Architecture Search Proceedings Article
In: pp. 428-432, 2020.
SOTERIA - In Search of Efficient Neural Networks for Private Inference Technical Report
2020.
What and Where - Learn to Plug Adapters via NAS for Multi-Domain Learning Technical Report
2020.
CurveLane-NAS - Unifying Lane-Sensitive Architecture Search and Adaptive Point Blending Proceedings Article
In: pp. 689-704, 2020.
Representation Sharing for Fast Object Detector Search and Beyond Proceedings Article
In: pp. 471-487, 2020.
AttentionNAS - Spatiotemporal Attention Cell Search for Video Classification Proceedings Article
In: pp. 449-465, 2020.
Weight-Sharing Neural Architecture Search - A Battle to Shrink the Optimization Gap Technical Report
2020.
MCUNet - Tiny Deep Learning on IoT Devices Proceedings Article
In: 2020.
Search What You Want - Barrier Panelty NAS for Mixed Precision Quantization Proceedings Article
In: pp. 1-16, 2020.
NSGANetV2 - Evolutionary Multi-objective Surrogate-Assisted Neural Architecture Search Proceedings Article
In: pp. 35-51, 2020.
CATCH - Context-Based Meta Reinforcement Learning for Transferrable Architecture Search Proceedings Article
In: pp. 185-202, 2020.
Standing on the Shoulders of Giants - Hardware and Neural Architecture Co-Search With Hot Start Journal Article
In: vol. 39, no. 11, pp. 4154-4165, 2020.
Off-Policy Reinforcement Learning for Efficient and Effective GAN Architecture Search Proceedings Article
In: pp. 175-192, 2020.
Neural Architecture Search for Speech Recognition Technical Report
2020.
BRP-NAS - Prediction-based NAS using GCNs Proceedings Article
In: 2020.
Finding Non-uniform Quantization Schemes Using Multi-task Gaussian Processes Proceedings Article
In: pp. 383-398, 2020.
One-Shot Neural Architecture Search via Novelty Driven Sampling Proceedings Article
In: pp. 3188-3194, 2020.
Neural Architecture Search in A Proxy Validation Loss Landscape Proceedings Article
In: pp. 5853-5862, 2020.
CP-NAS - Child-Parent Neural Architecture Search for 1-bit CNNs Proceedings Article
In: pp. 1033-1039, 2020.
SI-VDNAS - Semi-Implicit Variational Dropout for Hierarchical One-shot Neural Architecture Search Proceedings Article
In: pp. 2088-2095, 2020.
An Empirical Study on the Robustness of NAS based Architectures Technical Report
2020.
MergeNAS - Merge Operations into One for Differentiable Architecture Search Proceedings Article
In: pp. 3065-3072, 2020.
DropNAS - Grouped Operation Dropout for Differentiable Architecture Search Proceedings Article
In: pp. 2326-2332, 2020.
Towards evolving robust neural architectures to defend from adversarial attacks Proceedings Article
In: pp. 135-136, 2020.
Architecture Search of Dynamic Cells for Semantic Video Segmentation Proceedings Article
In: pp. 1959-1968, 2020.
Breaking the Curse of Space Explosion - Towards Efficient NAS with Curriculum Search Proceedings Article
In: pp. 3822-3831, 2020.
Towards Automated Neural Interaction Discovery for Click-Through Rate Prediction Proceedings Article
In: pp. 945-955, 2020.
MS-NAS - Multi-scale Neural Architecture Search for Medical Image Segmentation Proceedings Article
In: pp. 388-397, 2020.
VINNAS - Variational Inference-based Neural Network Architecture Search Technical Report
2020.
Multi-modality Information Fusion for Radiomics-Based Neural Architecture Search Proceedings Article
In: pp. 763-771, 2020.
Neural Graph Embedding for Neural Architecture Search Proceedings Article
In: pp. 4707-4714, 2020.
Ensembles of Networks Produced from Neural Architecture Search Proceedings Article
In: pp. 223-234, 2020.
A Study on Encodings for Neural Architecture Search Proceedings Article
In: 2020.
Neural Architecture Search with GBDT Technical Report
2020.
NASGEM - Neural Architecture Search via Graph Embedding Method Technical Report
2020.
Neuro-evolution using game-driven cultural algorithms Proceedings Article
In: pp. 1857-1865, 2020.
An evolution-based approach for efficient differentiable architecture search Proceedings Article
In: pp. 131-132, 2020.
HyperFDA: A Bi-Level Optimization Approach to Neural Architecture Search and Hyperparameters' Optimization via Fractal Decomposition-Based Algorithm Technical Report
Cancún, Mexico, 2020, ISBN: 9781450371278.
Towards evolving robust neural architectures to defend from adversarial attacks Proceedings Article
In: pp. 135-136, 2020.
A first step toward incremental evolution of convolutional neural networks Proceedings Article
In: pp. 115-116, 2020.
Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search Technical Report
2020.
Journey Towards Tiny Perceptual Super-Resolution Proceedings Article
In: pp. 85-102, 2020.
Hyperparameter Optimization in Neural Networks via Structured Sparse Recovery Technical Report
2020.
GOLD-NAS - Gradual, One-Level, Differentiable Technical Report
2020.