Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.


1018 entries « 1 of 21 »

2021

1018.

Chen, Wuyang; Gong, Xinyu; Wang, Zhangyang

Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective Inproceedings

ICLR 2021, 2021.

Links | BibTeX

1017.

Pan, Zheyi; Ke, Songyu; Yang, Xiaodu; Liang, Yuxuan; Yu, Yong; Zhang, Junbo; Zheng, Yu

AutoSTG: Neural Architecture Search forPredictions of Spatio-Temporal Graphs Inproceedings

WWW 2021, 2021.

Links | BibTeX

1016.

Liu, Lanlan; Zhang, Yuting; Deng, Jia; Soatto, Stefano

Dynamically Grown Generative Adversarial Networks Inproceedings

AAAI 2021, 2021.

Links | BibTeX

1015.

Xu, Y; Xie, L; Dai, W; Zhang, X; Chen, X; Qi, G; Xiong, H; Tian, Q

Partially-Connected Neural Architecture Search for Reduced Computational Redundancy Journal Article

IEEE Transactions on Pattern Analysis & Machine Intelligence, (01), pp. 1-1, 2021, ISSN: 1939-3539.

Abstract | Links | BibTeX

1014.

Wu, Junru; Dai, Xiyang; Chen, Dongdong; Chen, Yinpeng; Liu, Mengchen; Yu, Ye; Wang, Zhangyang; Liu, Zicheng; Chen, Mei; Yuan, Lu

Weak NAS Predictors Are All You Need Technical Report

2021.

Links | BibTeX

1013.

Guo, Yong; Zheng, Yin; Tan, Mingkui; Chen, Qi; Li, Zhipeng; Chen, Jian; Zhao, Peilin; Huang, Junzhou

Towards Accurate and Compact Architectures via Neural Architecture Transformer Technical Report

2021.

Links | BibTeX

1012.

Nguyen, Nam; Chang, Morris J

Contrastive Self-supervised Neural Architecture Search Miscellaneous

2021.

Links | BibTeX

1011.

Nayman, Niv; Aflalo, Yonathan; Noy, Asaf; Zelnik-Manor, Lihi

HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search Technical Report

2021.

Links | BibTeX

1010.

Hu, Liangxiao; Liu, Qinglin; Zhang, Jun; Jiang, Feng; Liu, Yang; Zhang, Shengping

A-DARTS: attention-guided differentiable architecture search for lung nodule classification Journal Article

Journal of Electronic Imaging, 30 (1), pp. 1 – 11, 2021.

Abstract | Links | BibTeX

1009.

Zhou, Yanqi; Dong, Xuanyi; Akin, Berkin; Tan, Mingxing; Peng, Daiyi; Meng, Tianjian; Yazdanbakhsh, Amir; Huang, Da; Narayanaswami, Ravi; Laudon, James

Rethinking Co-design of Neural Architectures and Hardware Accelerators Technical Report

, 2021.

Links | BibTeX

1008.

Ru, Binxin; Wan, Xingchen; Dong, Xiaowen; Osborne, Michael

Interpretable Neural Architecture Search via Bayesian Optimisation with Weisfeiler-Lehman Kernels Inproceedings

International Conference on Learning Representations, 2021.

Links | BibTeX

1007.

Roberts, Nicholas Carl; Khodak, Mikhail; Dao, Tri; Li, Liam; Balcan, Nina; Re, Christopher; Talwalkar, Ameet

Searching for Convolutions and a More Ambitious NAS Miscellaneous

2021.

Links | BibTeX

1006.

Wang, Dilin; Gong, Chengyue; Li, Meng; Liu, Qiang; Chandra, Vikas

AlphaNet: Improved Training of Supernet with Alpha-Divergence Technical Report

, 2021.

Links | BibTeX

1005.

Robbiano, Luca; Rahman, Muhammad Rameez Ur; Galasso, Fabio; Caputo, Barbara; Carlucci, Fabio Maria

Adversarial Branch Architecture Search for Unsupervised Domain Adaptation Technical Report

, 2021.

Links | BibTeX

1004.

Calisto, Maria Baldeon G; Lai-Yuen, Susana K

EMONAS: efficient multiobjective neural architecture search framework for 3D medical image segmentation Inproceedings

Išgum, Ivana; Landman, Bennett A (Ed.): Medical Imaging 2021: Image Processing, pp. 22 – 34, International Society for Optics and Photonics SPIE, 2021.

Abstract | Links | BibTeX

1003.

Yan, Shen; Song, Kaiqiang; Liu, Fei; Zhang, Mi

CATE: Computation-aware Neural Architecture Encoding with Transformers Technical Report

, 2021.

Links | BibTeX

1002.

Lopes, Vasco; Alirezazadeh, Saeid; í, Lu

EPE-NAS: Efficient Performance Estimation Without Training for Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

1001.

Turner, Jack; Crowley, Elliot J; O'Boyle, Michael F P

Neural Architecture Search as Program Transformation Exploration Technical Report

, 2021.

Links | BibTeX

1000.

Sun, Y; Sun, X; Fang, Y; Yen, G G; Liu, Y

A Novel Training Protocol for Performance Predictors of Evolutionary Neural Architecture Search Algorithms Journal Article

IEEE Transactions on Evolutionary Computation, pp. 1-1, 2021.

Abstract | Links | BibTeX

999.

Su, Xiu; You, Shan; Huang, Tao; Wang, Fei; Qian, Chen; Zhang, Changshui; Xu, Chang

Locally Free Weight Sharing for Network Width Search Technical Report

2021.

Links | BibTeX

998.

Liu, Peidong; Zhang, Gengwei; Wang, Bochao; Xu, Hang; Liang, Xiaodan; Jiang, Yong; Li, Zhenguo

Loss Function Discovery for Object Detection via Convergence-Simulation Driven Search Technical Report

2021.

Links | BibTeX

997.

He, Xin; Zhao, Kaiyong; Chu, Xiaowen

AutoML: A Survey of the State-of-the-Art Journal Article

Knowledge-Based Systems, 212 , pp. 106622, 2021.

Abstract | Links | BibTeX

996.

Li, Sheng; Tan, Mingxing; Pang, Ruoming; Li, Andrew; Cheng, Liqun; Le, Quoc; Jouppi, Norman P

Searching for Fast Model Families on Datacenter Accelerators Technical Report

2021.

Links | BibTeX

995.

Wang, W; Zhu, L

Reliable Network Search Based on Evolutionary Algorithm Inproceedings

2021 International Conference on Computer, Control and Robotics (ICCCR), pp. 279-282, 2021.

Abstract | Links | BibTeX

994.

Lou, Xiaoxuan; Guo, Shangwei; Zhang, Tianwei; Zhang, Yinqian; Liu, Yang

When NAS Meets Watermarking: Ownership Verification of DNN Models via Cache Side Channels Technical Report

, 2021.

Links | BibTeX

993.

Fu, Xianya; Li, Wenrui; Chen, Qiurui; Zhang, Lianyi; Yang, Kai; Qing, Duzheng; Wang, Rui

NASIL: Neural Network Architecture Searching for Incremental Learning in Image Classification Inproceedings

Ning, Li; Chau, Vincent; Lau, Francis (Ed.): Parallel Architectures, Algorithms and Programming, pp. 68–80, Springer Singapore, Singapore, 2021, ISBN: 978-981-16-0010-4.

Abstract | Links | BibTeX

992.

Li, Xiaohan; Xie, Ziyan; Lai, Taotao; Zhao, Fusheng; Xu, Haiyin; Chen, Riqing

NAS-WFPN: Neural Architecture Search Weighted Feature Pyramid Networks for Object Detection Inproceedings

Wang, Guojun; Chen, Bing; Li, Wei; Pietro, Roberto Di; Yan, Xuefeng; Han, Hao (Ed.): Security, Privacy, and Anonymity in Computation, Communication, and Storage, pp. 384–394, Springer International Publishing, Cham, 2021, ISBN: 978-3-030-68884-4.

Links | BibTeX

991.

Luo, Renqian; Tan, Xu; Wang, Rui; Qin, Tao; Li, Jinzhu; Zhao, Sheng; Chen, Enhong; -, Tie

LightSpeech: Lightweight and Fast Text to Speech with Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

990.

Lang, Sebastian; Reggelin, Tobias; Schmidt, Johann; Müller, Marcel; Nahhas, Abdulrahman

NeuroEvolution of augmenting topologies for solving a two-stage hybrid flow shop scheduling problem: A comparison of different solution strategies Journal Article

Expert Systems with Applications, 172 , pp. 114666, 2021, ISSN: 0957-4174.

Abstract | Links | BibTeX

989.

Jie, R; Gao, J

Differentiable Neural Architecture Search for High-Dimensional Time Series Forecasting Journal Article

IEEE Access, 9 , pp. 20922-20932, 2021.

Links | BibTeX

988.

Liang, Shuang; Tang, Changcheng; Ning, Xuefei; Zeng, Shulin; Yu, Jincheng; Wang, Yu; Guo, Kaiyuan; Yang, Diange; Lu, Tianyi; Yang, Huazhong

Efficient Computing Platform Design for Autonomous Driving Systems Inproceedings

Proceedings of the 26th Asia and South Pacific Design Automation Conference, pp. 734–741, Association for Computing Machinery, Tokyo, Japan, 2021, ISBN: 9781450379991.

Abstract | Links | BibTeX

987.

Odema, Mohanad; Rashid, Nafiul; Faruque, Mohammad Abdullah Al

Energy-Aware Design Methodology for Myocardial Infarction Detection on Low-Power Wearable Devices Inproceedings

Proceedings of the 26th Asia and South Pacific Design Automation Conference, pp. 621–626, Association for Computing Machinery, Tokyo, Japan, 2021, ISBN: 9781450379991.

Abstract | Links | BibTeX

986.

Lin, Ming; Wang, Pichao; Sun, Zhenhong; Chen, Hesen; Sun, Xiuyu; Qian, Qi; Li, Hao; Jin, Rong

Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition Technical Report

, 2021.

Links | BibTeX

985.

Gomez-Rosero, Santiago; Capretz, Miriam A M; Mir, Syed

Transfer Learning by Similarity Centred Architecture Evolution for Multiple Residential Load Forecasting Journal Article

Smart Cities, 4 (1), pp. 217–240, 2021, ISSN: 2624-6511.

Abstract | Links | BibTeX

984.

Lyu, B; Yuan, H; Lu, L; Zhang, Y

Resource-constrained Neural Architecture Search on Edge Devices Journal Article

IEEE Transactions on Network Science and Engineering, pp. 1-1, 2021.

Links | BibTeX

983.

Pinos, Michal; Mrazek, Vojtech; á, Luk

Evolutionary Neural Architecture Search Supporting Approximate Multipliers Technical Report

, 2021.

Links | BibTeX

982.

Lu, Longfei; Lyu, Bo

Reducing energy consumption of Neural Architecture Search: An inference latency prediction framework Journal Article

Sustainable Cities and Society, 67 , pp. 102747, 2021, ISSN: 2210-6707.

Abstract | Links | BibTeX

981.

Yang, Yibo; You, Shan; Li, Hongyang; Wang, Fei; Qian, Chen; Lin, Zhouchen

Towards Improving the Consistency, Efficiency, and Flexibility of Differentiable Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

980.

Liang, Xinle; Liu, Yang; Luo, Jiahuan; He, Yuanqin; Chen, Tianjian; Yang, Qiang

Self-supervised Cross-silo Federated Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

979.

Zhang, Xuanyang; Hou, Pengfei; Zhang, Xiangyu; Sun, Jian

Neural Architecture Search with Random Labels Technical Report

, 2021.

Links | BibTeX

978.

Kertész, Gábor; Szénási, Sándor; Vámossy, Zoltán

Comparative analysis of image projection-based descriptors in Siamese neural networks Journal Article

Advances in Engineering Software, 154 , pp. 102963, 2021, ISSN: 0965-9978.

Abstract | Links | BibTeX

977.

Zhao, Jiakun; Zhang, Ruifeng; Zhou, Zheng; Chen, Si; Jin, Ju; Liu, Qingfang

A Neural Architecture Search Method Based on Gradient Descent for Remaining Useful Life Estimation Journal Article

Neurocomputing, 2021, ISSN: 0925-2312.

Abstract | Links | BibTeX

976.

He, Xin; Wang, Shihao; Ying, Guohao; Zhang, Jiyong; Chu, Xiaowen

Efficient Multi-objective Evolutionary 3D Neural Architecture Search for COVID-19 Detection with Chest CT Scans Technical Report

, 2021.

Links | BibTeX

975.

Benmeziane, Hadjer; Maghraoui, Kaoutar El; Ouarnoughi, Hamza; ï, Sma; Wistuba, Martin; Wang, Naigang

A Comprehensive Survey on Hardware-Aware Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

974.

Abdelfattah, Mohamed S; Mehrotra, Abhinav; Dudziak, Lukasz; Lane, Nicholas D

Zero-Cost Proxies for Lightweight NAS Technical Report

, 2021.

Links | BibTeX

973.

Fu, Chaoyou; Hu, Yibo; Wu, Xiang; Shi, Hailin; Mei, Tao; He, Ran

CM-NAS: Rethinking Cross-Modality Neural Architectures for Visible-Infrared Person Re-Identification Technical Report

, 2021.

Links | BibTeX

972.

Wu, Haiwei; Zhou, Jiantao

GIID-Net: Generalizable Image Inpainting Detection via Neural Architecture Search and Attention Technical Report

, 2021.

Links | BibTeX

971.

Song, Xingyou; Choromanski, Krzysztof; -, Jack Parker; Tang, Yunhao; Peng, Daiyi; Jain, Deepali; Gao, Wenbo; Pacchiano, Aldo; ó, Tamás Sarl; Yang, Yuxiang

ES-ENAS: Combining Evolution Strategies with Neural Architecture Search at No Extra Cost for Reinforcement Learning Technical Report

, 2021.

Links | BibTeX

970.

Li, Qing; Wu, Xia; Liu, Tianming

Differentiable Neural Architecture Search for Optimal Spatial/Temporal Brain Function Network Decomposition Journal Article

Medical Image Analysis, pp. 101974, 2021, ISSN: 1361-8415.

Abstract | Links | BibTeX

969.

Vaccaro, Lorenzo; Sansonetti, Giuseppe; Micarelli, Alessandro

An Empirical Review of Automated Machine Learning Journal Article

Computers, 10 (1), 2021, ISSN: 2073-431X.

Abstract | Links | BibTeX

1018 entries « 1 of 21 »