Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.


1111 entries « 3 of 23 »

2021

1011.

Ding, Z; Chen, Y; Li, N; Zhao, D; Sun, Z; Chen, C L P

BNAS: Efficient Neural Architecture Search Using Broad Scalable Architecture Journal Article

IEEE Transactions on Neural Networks and Learning Systems, pp. 1-15, 2021.

Links | BibTeX

1010.

Ren, Pengzhen; Xiao, Gang; Chang, Xiaojun; Xiao, Yun; Li, Zhihui; Chen, Xiaojiang

NAS-TC: Neural Architecture Search on Temporal Convolutions for Complex Action Recognition Technical Report

, 2021.

Links | BibTeX

1009.

Dong, Heyou; Chen, Dan; Zhang, Lei; Ke, Hengjin; Li, Xiaoli

Subject Sensitive EEG Discrimination with Fast Reconstructable CNN Driven by Reinforcement Learning: A Case Study of ASD Evaluation Journal Article

Neurocomputing, 2021, ISSN: 0925-2312.

Abstract | Links | BibTeX

1008.

Lee, Hayeon; Hyung, Eunyoung; Hwang, Sung Ju

Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets Inproceedings

International Conference on Learning Representations, 2021.

Links | BibTeX

1007.

Wang, J; Zhao, J; An, J; Wang, D; Qiu, M

A Linear NAS Service of ConvNets for Fast Deployment in the Edge of 5G Networks Journal Article

IEEE Network, 35 (2), pp. 46-52, 2021.

Links | BibTeX

1006.

Shi, Xian; Zhou, Pan; Chen, Wei; Xie, Lei

Darts-Conformer: Towards Efficient Gradient-Based Neural Architecture Search For End-to-End ASR Technical Report

, 2021.

Links | BibTeX

1005.

Ganepola, Vayangi Vishmi Vishara; Wirasingha, Torin

Automating Generative Adversarial Networks using Neural Architecture Search: A Review Inproceedings

2021 International Conference on Emerging Smart Computing and Informatics (ESCI), pp. 577-582, 2021.

Links | BibTeX

1004.

Zappella, Giovanni; Salinas, David; Archambeau, Cédric

A resource-efficient method for repeated HPO and NAS problems Technical Report

, 2021.

Links | BibTeX

1003.

Liu, Hongying; Xu, Derong; Zhu, Tianwen; Shang, Fanhua; Liu, Yuanyuan; Lu, Jianhua; Yang, Ri

Graph Convolutional Networks by Architecture Search for PolSAR Image Classification Journal Article

Remote Sensing, 13 (7), 2021, ISSN: 2072-4292.

Abstract | Links | BibTeX

1002.

Guo, Shaopeng; Wang, Yujie; Yuan, Kun; Li, Quanquan

Differentiable Network Adaption with Elastic Search Space Technical Report

, 2021.

Links | BibTeX

1001.

Schmidgall, Samuel

Self-Constructing Neural Networks Through Random Mutation Technical Report

, 2021.

Links | BibTeX

1000.

He, Yufan; Yang, Dong; Roth, Holger; Zhao, Can; Xu, Daguang

DiNTS: Differentiable Neural Network Topology Search for 3D Medical Image Segmentation Technical Report

, 2021.

Links | BibTeX

999.

Ge, Wanying; Panariello, Michele; Patino, Jose; Todisco, Massimiliano; Evans, Nicholas W D

Partially-Connected Differentiable Architecture Search for Deepfake and Spoofing Detection Technical Report

, 2021.

Links | BibTeX

998.

Roberts, Nicholas; Khodak, Mikhail; Dao, Tri; Li, Liam; é, Christopher R; Talwalkar, Ameet

Rethinking Neural Operations for Diverse Tasks Technical Report

, 2021.

Links | BibTeX

997.

Yu, Kaicheng; é, Ren; Salzmann, Mathieu

Landmark Regularization: Ranking Guided Super-Net Training in Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

996.

Liu, Yukun; Li, Ta; Zhang, Pengyuan; Yan, Yonghong

Improved Conformer-based End-to-End Speech Recognition Using Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

995.

Cai, Shaofei; Li, Liang; Deng, Jincan; Zhang, Beichen; Zha, Zheng-Jun; Su, Li; Huang, Qingming

Rethinking Graph Neural Network Search from Message-passing Technical Report

2021.

Links | BibTeX

994.

Li, Yanxi ; Wen, Zean ; Wang Yunhe, ; Xu, Chang

One-shot Graph Neural Architecture Search with Dynamic Search Space Inproceedings

AAAI 2021, 2021.

Links | BibTeX

993.

Wang, Chunnan; Chen, Bozhou; Li, Geng; Wang, Hongzhi

FL-AGCNS: Federated Learning Framework for Automatic Graph Convolutional Network Search Technical Report

, 2021.

Links | BibTeX

992.

Meng, Tianjian; Chen, Xiaohan; Jiang, Yifan; Wang, Zhangyang

A Design Space Study for LISTA and Beyond Inproceedings

International Conference on Learning Representations, 2021.

Links | BibTeX

991.

Lankford, Séamus

Open-Source Neural Architecture Search with Ensemble and Pre-trained Networks Journal Article

International Journal of Modeling and Optimization, 11 (2), pp. 33-41, 2021.

Links | BibTeX

990.

Liu, Aoming; Huang, Zehao; Huang, Zhiwu; Wang, Naiyan

Direct Differentiable Augmentation Search Technical Report

, 2021.

Links | BibTeX

989.

Tashiro, Kyosuke; Takeda, Koji; Tanaka, Kanji; Tomoe, Hiroki

TaylorMade VDD: Domain-adaptive Visual Defect Detector for High-mix Low-volume Production of Non-convex Cylindrical Metal Objects Technical Report

, 2021.

Links | BibTeX

988.

Peter, David; Roth, Wolfgang; Pernkopf, Franz

End-to-end Keyword Spotting using Neural Architecture Search and Quantization Technical Report

, 2021.

Links | BibTeX

987.

Mundt, Martin; Pliushch, Iuliia; Ramesh, Visvanathan

Neural Architecture Search of Deep Priors: Towards Continual Learning without Catastrophic Interference Technical Report

, 2021.

Links | BibTeX

986.

Ottelander, Tom Den; Dushatskiy, Arkadiy; Virgolin, Marco; Bosman, Peter A N

Local Search is a Remarkably Strong Baseline for Neural Architecture Search Inproceedings

Ishibuchi, Hisao; Zhang, Qingfu; Cheng, Ran; Li, Ke; Li, Hui; Wang, Handing; Zhou, Aimin (Ed.): Evolutionary Multi-Criterion Optimization - 11th International Conference, EMO 2021, Shenzhen, China, March 28-31, 2021, Proceedings, pp. 465–479, Springer, 2021.

Links | BibTeX

985.

Wang, Rui; Wei, Zhihua; Ji, Shouling; Hong, Zhen

EfficientTDNN: Efficient Architecture Search for Speaker Recognition in the Wild Technical Report

, 2021.

Links | BibTeX

984.

Zhao, Huan; Yao, Quanming; -, Wei

Search to aggregate neighborhood for graph neural network Technical Report

, 2021.

Links | BibTeX

983.

Abed, H; Gyires-Tóth, B

Efficient Neural Architecture Search for Long Short-Term Memory Networks Inproceedings

2021 IEEE 19th World Symposium on Applied Machine Intelligence and Informatics (SAMI), pp. 000287-000292, 2021.

Links | BibTeX

982.

Gracheva, Ekaterina

Trainless Model Performance Estimation for Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

981.

Wu, Xuan; Zhang, Xiuyi; Jia, Linhan; Chen, Liang; Liang, Yanchun; Zhou, You; Wu, Chunguo

Neural Architecture Search based on Cartesian Genetic Programming Coding Method Technical Report

, 2021.

Links | BibTeX

980.

Choi, Kwanghee; Choe, Minyoung; Lee, Hyelee

Pretraining Neural Architecture Search Controllers with Locality-based Self-Supervised Learning Technical Report

, 2021.

Links | BibTeX

979.

Luo, Xiangzhong; Liu, Di; Huai, Shuo; Liu, Weichen

HSCoNAS: Hardware-Software Co-Design of Efficient DNNs via Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

978.

Wang, Ruochen; Cheng, Minhao; Chen, Xiangning; Tang, Xiaocheng; Hsieh, Cho-Jui

Rethinking Architecture Selection in Differentiable NAS Inproceedings

International Conference on Learning Representations, 2021.

Links | BibTeX

977.

-, Sian; -, Wei

Searching by Generating: Flexible and Efficient One-Shot NAS with Architecture Generator Technical Report

, 2021.

Links | BibTeX

976.

Lakhmiri, Dounia; é, S

Use of static surrogates in hyperparameter optimization Technical Report

, 2021.

Links | BibTeX

975.

Inkawhich, Matthew; Inkawhich, Nathan; Davis, Eric; Li, Hai; Chen, Yiran

The Untapped Potential of Off-the-Shelf Convolutional Neural Networks Technical Report

, 2021.

Links | BibTeX

974.

Chen, Zhiqiang; Xu, Ting-Bing; Liao, Weijian; Li, Zhengcheng; Li, Jinpeng; Liu, Cheng-Lin; He, Huiguang

SNAP: Shaping neural architectures progressively via information density criterion Journal Article

Pattern Recognition, 116 , pp. 107923, 2021, ISSN: 0031-3203.

Abstract | Links | BibTeX

973.

Li, Chaojian; Yu, Zhongzhi; Fu, Yonggan; Zhang, Yongan; Zhao, Yang; You, Haoran; Yu, Qixuan; Wang, Yue; Lin, Yingyan

HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark Inproceedings

ICLR 2021, 2021.

Links | BibTeX

972.

Pyeon, Myeongjang; Moon, Jihwan; Hahn, Taeyoung; Kim, Gunhee

SEDONA: Search for Decoupled Neural Networks toward Greedy Block-wise Learning Inproceedings

International Conference on Learning Representations, 2021.

Links | BibTeX

971.

Zhou, Allan; Knowles, Tom; Finn, Chelsea

Meta-learning Symmetries by Reparameterization Inproceedings

International Conference on Learning Representations, 2021.

Links | BibTeX

970.

Mehrotra, Abhinav; Ramos, Alberto Gil C P; Bhattacharya, Sourav; Ł, ; Vipperla, Ravichander; Chau, Thomas; Abdelfattah, Mohamed S; Ishtiaq, Samin; Lane, Nicholas Donald

NAS-Bench-ASR: Reproducible Neural Architecture Search for Speech Recognition Inproceedings

International Conference on Learning Representations, 2021.

Links | BibTeX

969.

Zhou, Daquan; Jin, Xiaojie; Lian, Xiaochen; Yang, Linjie; Xue, Yujing; Hou, Qibin; Feng, Jiashi

AutoSpace: Neural Architecture Search with Less Human Interference Technical Report

, 2021.

Links | BibTeX

968.

Li, Changlin; Tang, Tao; Wang, Guangrun; Peng, Jiefeng; Wang, Bing; Liang, Xiaodan; Chang, Xiaojun

BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

967.

Yan, Bin; Peng, Houwen; Wu, Kan; Wang, Dong; Fu, Jianlong; Lu, Huchuan

LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search Inproceedings

CVPR2021, 2021.

Links | BibTeX

966.

Wang, Jiahao; Shu, Han; Xia, Weihao; Yang, Yujiu; Wang, Yunhe

Coarse-to-Fine Searching for Efficient Generative Adversarial Networks Technical Report

2021.

Links | BibTeX

965.

Ahn, Joon Young; Cho, Nam Ik

Neural Architecture Search for Image Super-Resolution Using Densely Constructed Search Space: DeCoNAS Technical Report

2021.

Links | BibTeX

964.

Lu, Zexin; Xia, Wenjun; Huang, Yongqiang; Shan, Hongming; Chen, Hu; Zhou, Jiliu; Zhang, Yi

MANAS: Multi-Scale and Multi-Level Neural Architecture Search for Low-Dose CT Denoising Journal Article

CoRR, abs/2103.12995 , 2021.

Links | BibTeX

963.

Yin, Yihang; Huang, Siyu; Zhang, Xiang; Dou, Dejing

BM-NAS: Bilevel Multimodal Neural Architecture Search Technical Report

2021.

Links | BibTeX

962.

Su, Xiu; Huang, Tao; Li, Yanxi; You, Shan; Wang, Fei; Qian, Chen; Zhang, Changshui; Xu, Chang

Prioritized Architecture Sampling with Monto-Carlo Tree Search Technical Report

, 2021.

Links | BibTeX

1111 entries « 3 of 23 »