Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.


1046 entries « 2 of 21 »

2021

996.

Li, Sheng; Tan, Mingxing; Pang, Ruoming; Li, Andrew; Cheng, Liqun; Le, Quoc; Jouppi, Norman P

Searching for Fast Model Families on Datacenter Accelerators Technical Report

2021.

Links | BibTeX

995.

He, Xin; Zhao, Kaiyong; Chu, Xiaowen

AutoML: A Survey of the State-of-the-Art Journal Article

Knowledge-Based Systems, 212 , pp. 106622, 2021.

Abstract | Links | BibTeX

994.

Liu, Peidong; Zhang, Gengwei; Wang, Bochao; Xu, Hang; Liang, Xiaodan; Jiang, Yong; Li, Zhenguo

Loss Function Discovery for Object Detection via Convergence-Simulation Driven Search Technical Report

2021.

Links | BibTeX

993.

Su, Xiu; You, Shan; Huang, Tao; Wang, Fei; Qian, Chen; Zhang, Changshui; Xu, Chang

Locally Free Weight Sharing for Network Width Search Technical Report

2021.

Links | BibTeX

992.

Sun, Y; Sun, X; Fang, Y; Yen, G G; Liu, Y

A Novel Training Protocol for Performance Predictors of Evolutionary Neural Architecture Search Algorithms Journal Article

IEEE Transactions on Evolutionary Computation, pp. 1-1, 2021.

Abstract | Links | BibTeX

991.

Turner, Jack; Crowley, Elliot J; O'Boyle, Michael F P

Neural Architecture Search as Program Transformation Exploration Technical Report

, 2021.

Links | BibTeX

990.

Lopes, Vasco; Alirezazadeh, Saeid; í, Lu

EPE-NAS: Efficient Performance Estimation Without Training for Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

989.

Yan, Shen; Song, Kaiqiang; Liu, Fei; Zhang, Mi

CATE: Computation-aware Neural Architecture Encoding with Transformers Technical Report

, 2021.

Links | BibTeX

988.

Calisto, Maria Baldeon G; Lai-Yuen, Susana K

EMONAS: efficient multiobjective neural architecture search framework for 3D medical image segmentation Inproceedings

Išgum, Ivana; Landman, Bennett A (Ed.): Medical Imaging 2021: Image Processing, pp. 22 – 34, International Society for Optics and Photonics SPIE, 2021.

Abstract | Links | BibTeX

987.

Guo, Yong; Zheng, Yin; Tan, Mingkui; Chen, Qi; Li, Zhipeng; Chen, Jian; Zhao, Peilin; Huang, Junzhou

Towards Accurate and Compact Architectures via Neural Architecture Transformer Technical Report

2021.

Links | BibTeX

986.

Ban, Hao; Xie, Pengtao

Interleaving Learning, with Application to Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

985.

Liu, Xiaobo; Zhang, Chaochao; Cai, Zhihua; Yang, Jianfeng; Zhou, Zhilang; Gong, Xin

Continuous Particle Swarm Optimization-Based Deep Learning Architecture Search for Hyperspectral Image Classification Journal Article

Remote Sensing, 13 (6), 2021, ISSN: 2072-4292.

Abstract | Links | BibTeX

984.

Zhang, Shi-Xin; Hsieh, Chang-Yu; Zhang, Shengyu; Yao, Hong

Neural Predictor based Quantum Architecture Search Technical Report

2021.

Links | BibTeX

983.

Cao, Shengcao; Wang, Xiaofang; Kitani, Kris

Efficient Model Performance Estimation via Feature Histories Technical Report

, 2021.

Links | BibTeX

982.

Liang, Tingting; Wang, Yongtao; Tang, Zhi; Hu, Guosheng; Ling, Haibin

OPANAS: One-Shot Path Aggregation Network Architecture Search for Object Detection Technical Report

2021.

Links | BibTeX

981.

Zhang, Kaiyu; Chen, Jinglong; He, Shuilong; Xu, Enyong; Li, Fudong; Zhou, Zitong

Differentiable neural architecture search augmented with pruning and multi-objective optimization for time-efficient intelligent fault diagnosis of machinery Journal Article

Mechanical Systems and Signal Processing, 158 , pp. 107773, 2021, ISSN: 0888-3270.

Abstract | Links | BibTeX

980.

Chen, Yaofo; Guo, Yong; Chen, Qi; Li, Minli; Wang, Yaowei; Zeng, Wei; Tan, Mingkui

Contrastive Neural Architecture Search with Neural Architecture Comparators Technical Report

, 2021.

Links | BibTeX

979.

Choi, Kwanghee; Choe, Minyoung; Lee, Hyelee

Pretraining Neural Architecture Search Controllers with Locality-based Self-Supervised Learning Technical Report

, 2021.

Links | BibTeX

978.

Javeri, Indrajeet Y; Toutiaee, Mohammadhossein; Arpinar, Ismailcem B; Miller, Tom W; Miller, John A

Improving Neural Networks for Time Series Forecasting using Data Augmentation and AutoML Technical Report

2021.

Links | BibTeX

977.

Gracheva, Ekaterina

Trainless Model Performance Estimation for Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

976.

Guo, Qingbei; Wu, Xiao-Jun; Kittler, Josef; Feng, Zhiquan

Differentiable Neural Architecture Learning for Efficient Neural Network Design Technical Report

2021.

Links | BibTeX

975.

Wu, Xuan; Zhang, Xiuyi; Jia, Linhan; Chen, Liang; Liang, Yanchun; Zhou, You; Wu, Chunguo

Neural Architecture Search based on Cartesian Genetic Programming Coding Method Technical Report

, 2021.

Links | BibTeX

974.

Liu, Luyan; Wen, Zhiwei; Liu, Songwei; Zhou, Hong-Yu; Zhu, Hongwei; Xie, Weicheng; Shen, Linlin; Ma, Kai; Zheng, Yefeng

MixSearch: Searching for Domain Generalized Medical Image Segmentation Architectures Technical Report

2021.

Links | BibTeX

973.

Zhang, Ziwei; Wang, Xin; Zhu, Wenwu

Automated Machine Learning on Graphs: A Survey Technical Report

2021.

Links | BibTeX

972.

Luo, Xiangzhong; Liu, Di; Huai, Shuo; Liu, Weichen

HSCoNAS: Hardware-Software Co-Design of Efficient DNNs via Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

971.

Jeong, Wonyong; Lee, Hayeon; Park, Gun; Hyung, Eunyoung; Baek, Jinheon; Hwang, Sung Ju

Task-Adaptive Neural Network Retrieval with Meta-Contrastive Learning Technical Report

2021.

Links | BibTeX

970.

Guo, Yong; Chen, Yaofo; Zheng, Yin; Chen, Qi; Zhao, Peilin; Chen, Jian; Huang, Junzhou; Tan, Mingkui

Pareto-Frontier-aware Neural Architecture Generation for Diverse Budgets Technical Report

2021.

Links | BibTeX

969.

Le, Cat P; Soltani, Mohammadreza; Ravier, Robert; Tarokh, Vahid

Neural Architecture Search From Task Similarity Measure Technical Report

2021.

Links | BibTeX

968.

Xie, Guoyang; Wang, Jinbao; Yu, Guo; Zheng, Feng; Jin, Yaochu

Tiny Adversarial Mulit-Objective Oneshot Neural Architecture Search Technical Report

2021.

Links | BibTeX

967.

Zhang, T; Lei, C; Zhang, Z; Meng, X -B; Chen, C L P

AS-NAS: Adaptive Scalable Neural Architecture Search with Reinforced Evolutionary Algorithm for Deep Learning Journal Article

IEEE Transactions on Evolutionary Computation, pp. 1-1, 2021.

Links | BibTeX

966.

Chen, J; Jiang, Y; Huang, Z; Guo, X; Wu, B; Sun, L; Wu, T

Fine-Grained Detection of Driver Distraction Based on Neural Architecture Search Journal Article

IEEE Transactions on Intelligent Transportation Systems, pp. 1-19, 2021.

Links | BibTeX

965.

Zhang, Zijun; Cofer, Evan M; Troyanskaya, Olga G

AMBIENT: Accelerated Convolutional Neural Network Architecture Search for Regulatory Genomics Inproceedings

Machine Learning in Computational Biology (MLCB 2020), 2021.

Links | BibTeX

964.

Wu, Junru; Dai, Xiyang; Chen, Dongdong; Chen, Yinpeng; Liu, Mengchen; Yu, Ye; Wang, Zhangyang; Liu, Zicheng; Chen, Mei; Yuan, Lu

Weak NAS Predictors Are All You Need Technical Report

2021.

Links | BibTeX

963.

Nguyen, Nam; Chang, Morris J

Contrastive Self-supervised Neural Architecture Search Miscellaneous

2021.

Links | BibTeX

962.

Nayman, Niv; Aflalo, Yonathan; Noy, Asaf; Zelnik-Manor, Lihi

HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search Technical Report

2021.

Links | BibTeX

961.

Roberts, Nicholas Carl; Khodak, Mikhail; Dao, Tri; Li, Liam; Balcan, Nina; Re, Christopher; Talwalkar, Ameet

Searching for Convolutions and a More Ambitious NAS Miscellaneous

2021.

Links | BibTeX

960.

Robbiano, Luca; Rahman, Muhammad Rameez Ur; Galasso, Fabio; Caputo, Barbara; Carlucci, Fabio Maria

Adversarial Branch Architecture Search for Unsupervised Domain Adaptation Technical Report

, 2021.

Links | BibTeX

959.

Wang, Dilin; Gong, Chengyue; Li, Meng; Liu, Qiang; Chandra, Vikas

AlphaNet: Improved Training of Supernet with Alpha-Divergence Technical Report

, 2021.

Links | BibTeX

958.

Wang, Ruochen; Cheng, Minhao; Chen, Xiangning; Tang, Xiaocheng; Hsieh, Cho-Jui

Rethinking Architecture Selection in Differentiable NAS Inproceedings

International Conference on Learning Representations, 2021.

Links | BibTeX

957.

Ru, Binxin; Wan, Xingchen; Dong, Xiaowen; Osborne, Michael

Interpretable Neural Architecture Search via Bayesian Optimisation with Weisfeiler-Lehman Kernels Inproceedings

International Conference on Learning Representations, 2021.

Links | BibTeX

956.

Zhou, Yanqi; Dong, Xuanyi; Akin, Berkin; Tan, Mingxing; Peng, Daiyi; Meng, Tianjian; Yazdanbakhsh, Amir; Huang, Da; Narayanaswami, Ravi; Laudon, James

Rethinking Co-design of Neural Architectures and Hardware Accelerators Technical Report

, 2021.

Links | BibTeX

955.

Hu, Liangxiao; Liu, Qinglin; Zhang, Jun; Jiang, Feng; Liu, Yang; Zhang, Shengping

A-DARTS: attention-guided differentiable architecture search for lung nodule classification Journal Article

Journal of Electronic Imaging, 30 (1), pp. 1 – 11, 2021.

Abstract | Links | BibTeX

954.

-, Sian; -, Wei

Searching by Generating: Flexible and Efficient One-Shot NAS with Architecture Generator Technical Report

, 2021.

Links | BibTeX

953.

Huang, Yufang; Axsom, Kelly M; Lee, John; Subramanian, Lakshminarayanan; Zhang, Yiye

DICE: Deep Significance Clustering for Outcome-Aware Stratification Technical Report

2021.

Links | BibTeX

952.

Ma, Ailong; Wan, Yuting; Zhong, Yanfei; Wang, Junjue; Zhang, Liangpei

SceneNet: Remote sensing scene classification deep learning network using multi-objective neural evolution architecture search Technical Report

, 2021, ISSN: 0924-2716.

Links | BibTeX

951.

Yang, Hansi; Yao, Quanming; Kwok, James T

Tensorizing Subgraph Search in the Supernet Technical Report

, 2021.

Links | BibTeX

950.

Syed, Muhtadyuzzaman; Srinivasan, Arvind Akpuram

Generalized Latency Performance Estimation for Once-For-All Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

949.

Huang, Hanxun; Ma, Xingjun; Erfani, Sarah M; Bailey, James

Neural Architecture Search via Combinatorial Multi-Armed Bandit Technical Report

, 2021.

Links | BibTeX

948.

Tang, Tianqi; Yu, Xin; Dong, Xuanyi; Yang, Yi

Auto-Navigator: Decoupled Neural Architecture Search for Visual Navigation Technical Report

2021.

Links | BibTeX

947.

Zheng, Shuai; Wang, Yabin; Li, Baotong; Li, Xin

A Hardware-adaptive Deep Feature Matching Pipeline for Real-time 3D Reconstruction Journal Article

132 , pp. 102984, 2021.

Links | BibTeX

1046 entries « 2 of 21 »