AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4193 entries « 71 of 84 »

2020

693.

Souquet, Léo; Shvai, Nadiya; Llanza, Arcadi; Nakib, Amir

HyperFDA: A Bi-Level Optimization Approach to Neural Architecture Search and Hyperparameters' Optimization via Fractal Decomposition-Based Algorithm Technical Report

Cancún, Mexico, 2020, ISBN: 9781450371278.

Links | BibTeX

692.

Kotyan, Shashank; Vargas, Danilo Vasconcellos

Towards evolving robust neural architectures to defend from adversarial attacks Proceedings Article

In: pp. 135-136, 2020.

Links | BibTeX

691.

Barnes, Dustin K; Davis, Sara R; Hand, Emily M; Louis, Sushil J

A first step toward incremental evolution of convolutional neural networks Proceedings Article

In: pp. 115-116, 2020.

Links | BibTeX

690.

Zhang, Haoyu; Jin, Yaochu; Cheng, Ran; Hao, Kuangrong

Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search Technical Report

2020.

Links | BibTeX

689.

Lee, Royson; Dudziak, Lukasz; Abdelfattah, Mohamed S; Venieris, Stylianos I; Kim, Hyeji; Wen, Hongkai; Lane, Nicholas D

Journey Towards Tiny Perceptual Super-Resolution Proceedings Article

In: pp. 85-102, 2020.

Links | BibTeX

688.

Cho, Minsu; Soltani, Mohammadreza; Hegde, Chinmay

Hyperparameter Optimization in Neural Networks via Structured Sparse Recovery Technical Report

2020.

Links | BibTeX

687.

Bi, Kaifeng; Xie, Lingxi; Chen, Xin; Wei, Longhui; Tian, Qi

GOLD-NAS - Gradual, One-Level, Differentiable Technical Report

2020.

Links | BibTeX

686.

Tian, Yunjie; Liu, Chang; Xie, Lingxi; Jiao, Jianbin; Ye, Qixiang

Discretization-Aware Architecture Search Technical Report

2020.

Links | BibTeX

685.

Vertechi, Pietro; Frosini, Patrizio; Bergomi, Mattia G

Parametric machines - a fresh approach to architecture search Technical Report

2020.

Links | BibTeX

684.

Wang, Chunnan; Wang, Hongzhi; Feng, Guocheng; Geng, Fei

Multi-Objective Neural Architecture Search Based on Diverse Structures and Adaptive Recommendation Technical Report

2020.

Links | BibTeX

683.

Wang, Bin; Xue, Bing; Zhang, Mengjie

Surrogate-assisted Particle Swarm Optimisation for Evolving Variable-length Transferable Blocks for Image Classification Journal Article

In: IEEE transactions on Neural Networks and Learning Systems, vol. abs/2007.01556, pp. 1-14, 2020.

Links | BibTeX

682.

Wang, Jiaxing; Wu, Jiaxiang; Bai, Haoli; Cheng, Jian

M-NAS - Meta Neural Architecture Search Proceedings Article

In: pp. 6186-6193, 2020.

Links | BibTeX

681.

Wang, Junjue; Zhong, Yanfei; Zheng, Zhuo; Ma, Ailong; Zhang, Liangpei

RSNet: The Search for Remote Sensing Deep Neural Networks in Recognition Tasks Technical Report

2020.

Links | BibTeX

680.

Zhou, Pan; Xiong, Caiming; Socher, Richard; Hoi, Steven Chu-Hong

Theory-Inspired Path-Regularized Differential Network Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

679.

Li, Yawei; Li, Wen; Danelljan, Martin; Zhang, Kai; Gu, Shuhang; Gool, Luc Van; Timofte, Radu

The Heterogeneity Hypothesis - Finding Layer-Wise Dissimilated Network Architecture Technical Report

2020.

Links | BibTeX

678.

Trillos, Nicolás García; Morales, Javier

Semi-discrete optimization through semi-discrete optimal transport - a framework for neural architecture search Technical Report

2020.

Links | BibTeX

677.

Trillos, Nicolás García; Morales, Felix; Morales, Javier

Traditional and accelerated gradient descent for neural architecture search Technical Report

2020.

Links | BibTeX

676.

Kügler, David; Uecker, Marc; Kuijper, Arjan; Mukhopadhyay, Anirban

AutoSNAP - Automatically Learning Neural Architectures for Instrument Pose Estimation Proceedings Article

In: pp. 375-384, 2020.

Links | BibTeX

675.

Li, Ting; Zhang, Junbo; Bao, Kainan; Liang, Yuxuan; Li, Yexin; Zheng, Yu

AutoST - Efficient Neural Architecture Search for Spatio-Temporal Prediction Proceedings Article

In: pp. 794-802, 2020.

Links | BibTeX

674.

O'Neill, Damien; Xue, Bing; Zhang, Mengjie

Neural architecture search for sparse DenseNets with dynamic compression Proceedings Article

In: pp. 386-394, 2020.

Links | BibTeX

673.

Zhou, Peng; Xie, Lingxi; Zhang, Xiaopeng; Ni, Bingbing; Tian, Qi

Searching towards Class-Aware Generators for Conditional Generative Adversarial Networks Technical Report

2020.

Links | BibTeX

672.

Lin, Ming; Chen, Hesen; Sun, Xiuyu; Qian, Qi; Li, Hao; Jin, Rong

Neural Architecture Design for GPU-Efficient Networks Technical Report

2020.

Links | BibTeX

671.

Süzen, Mehmet

Equivalence in Deep Neural Networks via Conjugate Matrix Ensembles Technical Report

2020.

Links | BibTeX

670.

Zimmer, Lucas; Lindauer, Marius; Hutter, Frank

Auto-PyTorch Tabular - Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Technical Report

2020.

Links | BibTeX

669.

Panda, Rameswar; Merler, Michele; Jaiswal, Mayoore; Wu, Hui; Ramakrishnan, Kandan; Finkler, Ulrich; Chen, Chun-Fu; Cho, Minsik; Kung, David S; Feris, Rogério; Bhattacharjee, Bishwaranjan

NASTransfer - Analyzing Architecture Transferability in Large Scale Neural Architecture Search Technical Report

2020.

Links | BibTeX

668.

Fang, Jiemin; Sun, Yuzhu; Zhang, Qian; Peng, Kangjian; Li, Yuan; Liu, Wenyu; Wang, Xinggang

FNA++ - Fast Network Adaptation via Parameter Remapping and Architecture Search Technical Report

2020.

Links | BibTeX

667.

Janik, Romuald A; Nowak, Aleksandra

Neural networks adapting to datasets - learning network size and topology Technical Report

2020.

Links | BibTeX

666.

Li, Yuening; Chen, Zhengzhang; Zha, Daochen; Zhou, Kaixiong; Jin, Haifeng; Chen, Haifeng; Hu, Xia

AutoOD - Automated Outlier Detection via Curiosity-guided Search and Self-imitation Learning Technical Report

2020.

Links | BibTeX

665.

Yang, Jianhua; Lu, Beiling; Xiao, Liang; Kang, Xiangui; Shi, Yunqing

Reinforcement Learning Aided Network Architecture Generation for JPEG Image Steganalysis Proceedings Article

In: pp. 23-32, 2020.

Links | BibTeX

664.

Rakhshani, Hojjat; Fawaz, Hassan Ismail; Idoumghar, Lhassane; Forestier, Germain; Lepagnot, Julien; Weber, Jonathan; Brévilliers, Mathieu; Muller, Pierre-Alain

Neural Architecture Search for Time Series Classification Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

663.

Yu, Hongyuan; Peng, Houwen

Cyclic Differentiable Architecture Search Technical Report

2020.

Links | BibTeX

662.

Singh, Ishika; Zhou, Haoyi; Yang, Kunlin; Ding, Meng; Lin, Bill; Xie, Pengtao

Differentially-private Federated Neural Architecture Search Technical Report

2020.

Links | BibTeX

661.

Chen, Xiangning; Wang, Ruochen; Cheng, Minhao; Tang, Xiaocheng; Hsieh, Cho-Jui

DrNAS - Dirichlet Neural Architecture Search Technical Report

2020.

Links | BibTeX

660.

Li, Jian; Liu, Yong; Liu, Jiankun; Wang, Weiping

Neural Architecture Optimization with Graph VAE Technical Report

2020.

Links | BibTeX

659.

Chaudhuri, Shraman Ray; Eban, Elad; Li, Hanhan; Moroz, Max; Movshovitz-Attias, Yair

Fine-Grained Stochastic Architecture Search Technical Report

2020.

Links | BibTeX

658.

Geada, Rob; Prangle, Dennis; McGough, Andrew Stephen

Bonsai-Net - One-Shot Neural Architecture Search via Differentiable Pruners Technical Report

2020.

Links | BibTeX

657.

Tian, Yuesong; Shen, Li; Shen, Li; Su, Guinan; Li, Zhifeng; Liu, Wei

AlphaGAN - Fully Differentiable Architecture Search for Generative Adversarial Networks Technical Report

2020.

Links | BibTeX

656.

Tanveer, Muhammad Suhaib; Khan, Muhammad Umar Karim; Kyung, Chong-Min

Fine-Tuning DARTS for Image Classification Technical Report

2020.

Links | BibTeX

655.

Ortiz-Jiménez, Guillermo; Modas, Apostolos; Moosavi-Dezfooli, Seyed-Mohsen; Frossard, Pascal

Neural Anisotropy Directions Proceedings Article

In: 2020.

Links | BibTeX

654.

Ghodsi, Zahra; Veldanda, Akshaj Kumar; Reagen, Brandon; Garg, Siddharth

CryptoNAS - Private Inference on a ReLU Budget Proceedings Article

In: 2020.

Links | BibTeX

653.

Radiuk, Pavlo; Kutucu, Hakan

Heuristic Architecture Search Using Network Morphism for Chest X-Ray Classification Proceedings Article

In: pp. 107-121, 2020.

Links | BibTeX

652.

Kokiopoulou, Efi; Hauth, Anja; Sbaiz, Luciano; Gesmundo, Andrea; Bartók, Gábor; Berent, Jesse

Task-Aware Performance Prediction for Efficient Architecture Search Proceedings Article

In: pp. 1238-1245, 2020.

Links | BibTeX

651.

Lu, Xiaotong; Huang, Han; Dong, Weisheng; Li, Xin; Shi, Guangming

Beyond Network Pruning - a Joint Search-and-Training Approach Proceedings Article

In: pp. 2583-2590, 2020.

Links | BibTeX

650.

Zaidi, Sheheryar; Zela, Arber; Elsken, Thomas; Holmes, Chris; Hutter, Frank; Teh, Yee Whye

Neural Ensemble Search for Performant and Calibrated Predictions Technical Report

2020.

Links | BibTeX

649.

Trofimov, Ilya; Klyuchnikov, Nikita; Salnikov, Mikhail; Filippov, Alexander; Burnaev, Evgeny

Multi-fidelity Neural Architecture Search with Knowledge Distillation Technical Report

2020.

Links | BibTeX

648.

Mohamed, Abduallah; Sadiq, Muhammed Mohaimin; AlBadawy, Ehab; Elhoseiny, Mohamed; Claudel, Christian

Inner Ensemble Networks: Average Ensemble as an Effective Regularizer Technical Report

2020.

Links | BibTeX

647.

Kim, Do-Guk; Lee, Heung-Chang

Differentiable Neural Architecture Transformation for Reproducible Architecture Improvement Technical Report

2020.

Links | BibTeX

646.

Ru, Bin Xin; Wan, Xingchen; Dong, Xiaowen; Osborne, Michael A

Neural Architecture Search using Bayesian Optimisation with Weisfeiler-Lehman Kernel Technical Report

2020.

Links | BibTeX

645.

Klyuchnikov, Nikita; Trofimov, Ilya; Artemova, Ekaterina; Salnikov, Mikhail; Fedorov, Maxim; Burnaev, Evgeny

NAS-Bench-NLP - Neural Architecture Search Benchmark for Natural Language Processing Technical Report

2020.

Links | BibTeX

644.

Yan, Shen; Zheng, Yu; Ao, Wei; Zeng, Xiao; Zhang, Mi

Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Proceedings Article

In: 2020.

Links | BibTeX

4193 entries « 71 of 84 »