AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3102 entries « 41 of 63 »

2021

1102.

Traoré, Kalifou René; Camero, Andrés; Zhu, Xiao Xiang

A Data-driven Approach to Neural Architecture Search Initialization Technical Report

2021.

Links | BibTeX

1101.

Eyono, Roy Henha; Carlucci, Fabio Maria; Esperança, Pedro M.; Ru, Binxin; Torr, Phillip

AUTOKD: Automatic Knowledge Distillation Into A Student Architecture Family Technical Report

2021.

Links | BibTeX

1100.

Xu, Zhimeng; Mai, Yuting; Liu, Denghui; He, Wenjun; Lin, Xinyuan; Xu, Chi; Zhang, Lei; Meng, Xin; Mafofo, Joseph; Zaher, Walid Abbas; Koshy, Ashish; Li, Yi; Qiao, Nan

Fast-bonito: A faster deep learning based basecaller for nanopore sequencing Journal Article

In: Artificial Intelligence in the Life Sciences, vol. 1, pp. 100011, 2021, ISSN: 2667-3185.

Abstract | Links | BibTeX

1099.

Yan, Shen; White, Colin; Savani, Yash; Hutter, Frank

NAS-Bench-x11 and the Power of Learning Curves Technical Report

2021.

Links | BibTeX

1098.

Ding, Xinyi; Han, Tao; Fang, Yili; Larson, Eric C.

An Approach for Combining Multimodal Fusion and Neural Architecture Search Applied to Knowledge Tracing Technical Report

2021.

Links | BibTeX

1097.

Wan, Xingchen; Ru, Binxin; Esperança, Pedro M.; Carlucci, Fabio Maria

Approximate Neural Architecture Search via Operation Distribution Learning Technical Report

2021.

Links | BibTeX

1096.

Lyu, Bo; Wen, Shiping; Yan, Zheng; Shi, Kaibo; Li, Ke; Huang, Tingwen

TND-NAS: Towards Non-differentiable Objectives in Progressive Differentiable NAS Framework Technical Report

2021.

Links | BibTeX

1095.

Garg, Bhanu; Zhang, Li; Sridhara, Pradyumna; Hosseini, Ramtin; Xing, Eric P.; Xie, Pengtao

Learning from Mistakes - A Framework for Neural Architecture Search Technical Report

2021.

Links | BibTeX

1094.

Zhao, Tianli; Zhang, Xi Sheryl; Zhu, Wentao; Wang, Jiaxing; Liu, Ji; Cheng, Jian

Joint Channel and Weight Pruning for Model Acceleration on Moblie Devices Technical Report

2021.

Links | BibTeX

1093.

Bhardwaj, Kartikeya; Li, Guihong; Marculescu, Radu

How Does Topology Influence Gradient Propagation and Model Performance of Deep Networks With DenseNet-Type Skip Connections? Proceedings Article

In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021, pp. 13498–13507, Computer Vision Foundation / IEEE, 2021.

Links | BibTeX

1092.

Gao, Chen; Li, Yinfeng; yao,; Jin, Depeng; Li, Yong

Progressive Feature Interaction Search for Deep Sparse Network Proceedings Article

In: Thirty-Fifth Conference on Neural Information Processing Systems, 2021.

Links | BibTeX

1091.

Chen, Minghao; Wu, Kan; Ni, Bolin; Peng, Houwen; Liu, Bei; Fu, Jianlong; Chao, Hongyang; Ling, Haibin

Searching the Search Space of Vision Transformer Proceedings Article

In: Advances in Neural Information Processing Systems 34 pre-proceedings (NeurIPS 2021) , 2021.

Links | BibTeX

1090.

Jeong, Wonyong; Lee, Hayeon; Park, Geon; Hyung, Eunyoung; Baek, Jinheon; Hwang, Sung Ju

Task-Adaptive Neural Network Retrieval with Meta-Contrastive Learning Proceedings Article

In: Thirty-Fifth Conference on Neural Information Processing Systems, 2021.

Links | BibTeX

1089.

Lu, Haodong; Du, Miao; He, Xiaoming; Qian, Kai; Chen, Jianli; Sun, Yanfei; Wang, Kun

An Adaptive Neural Architecture Search Design for Collaborative Edge-Cloud Computing Journal Article

In: IEEE Network, vol. 35, no. 5, pp. 83-89, 2021.

Links | BibTeX

1088.

Loni, Mohammad; Zoljodi, Ali; Majd, Amin; Ahn, Byung Hoon; Daneshtalab, Masoud; Sjödin, Mikael; Esmaeilzadeh, Hadi

FastStereoNet: A Fast Neural Architecture Search for Improving the Inference of Disparity Estimation on Resource-Limited Platforms Journal Article

In: IEEE Transactions on Systems, Man, and Cybernetics: Systems, pp. 1-13, 2021.

Links | BibTeX

1087.

Ding, Zixiang; Chen, Yaran; Li, Nannan; Zhao, Dongbin

Stacked BNAS: Rethinking Broad Convolutional Neural Network for Neural Architecture Search Technical Report

2021.

Links | BibTeX

1086.

Zhou, Yuan; Wang, Haiyang; Huo, Shuwei; Wang, Boyu

Full-attention based Neural Architecture Search using Context Auto-regression Technical Report

2021.

Links | BibTeX

1085.

Tian, Yuqing; Zhang, Zhaoyang; Yang, Zhaohui; Yang, Qianqian

JMSNAS: Joint Model Split and Neural Architecture Search for Learning over Mobile Edge Networks Technical Report

2021.

Links | BibTeX

1084.

Ahn, Joon Young; Cho, Nam Ik

Multi-Branch Neural Architecture Search for Lightweight Image Super-Resolution Journal Article

In: IEEE Access, vol. 9, pp. 153633-153646, 2021.

Links | BibTeX

1083.

Lee, Kyung-Chae; Linh, Le Vu; Kim, Heejae; Youn, Chan-Hyun

Neural Architecture Search for Computation Offloading of DNNs from Mobile Devices to the Edge Server Proceedings Article

In: International Conference on Information and Communication Technology Convergence, ICTC 2021, Jeju Island, Korea, Republic of, October 20-22, 2021, pp. 134–139, IEEE, 2021.

Links | BibTeX

1082.

Jing, Kun; Xu, Jungang; Zhang, Zhen

A neural architecture generator for efficient search space Journal Article

In: Neurocomputing, 2021, ISSN: 0925-2312.

Abstract | Links | BibTeX

1081.

Ye, Nanyang; Mei, Jingbiao; Fang, Zhicheng; Zhang, Yuwen; Zhang, Ziqing; Wu, Huaying; Liang, Xiaoyao

BayesFT: Bayesian Optimization for Fault Tolerant Neural Network Architecture Proceedings Article

In: 2021 58th ACM/IEEE Design Automation Conference (DAC), pp. 487-492, 2021.

Links | BibTeX

1080.

Zhao, Shize; He, Liulu; Xie, Xiaoru; Lin, Jun; Wang, Zhongfeng

Automatic Generation of Dynamic Inference Architecture for Deep Neural Networks Proceedings Article

In: 2021 IEEE Workshop on Signal Processing Systems (SiPS), pp. 117-122, 2021.

Links | BibTeX

1079.

Hafiz, Faizal; Broekaert, Jan; Torre, Davide La; Swain, Akshya

A Multi-criteria Approach to Evolve Sparse Neural Architectures for Stock Market Forecasting Technical Report

2021.

Links | BibTeX

1078.

Hosseini, Morteza; Mohsenin, Tinoosh

QS-NAS: Optimally Quantized Scaled Architecture Search to Enable Efficient On-Device Micro-AI Journal Article

In: IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 11, no. 4, pp. 597-610, 2021.

Links | BibTeX

1077.

Sivapathasundaram, Janakan; Poravi, Guhanathan

A Review on Automated Neural Network System for Tabular Data Proceedings Article

In: 2021 2nd Global Conference for Advancement in Technology (GCAT), pp. 1-5, 2021.

Links | BibTeX

1076.

Stier, Julian; Granitzer, Michael

deepstruct - linking deep learning and graph theory Technical Report

2021.

Links | BibTeX

1075.

Pi, Huaijin; Wang, Huiyu; Li, Yingwei; Li, Zizhang; Yuille, Alan L.

Searching for TrioNet: Combining Convolution with Local and Global Self-Attention Technical Report

2021.

Links | BibTeX

1074.

Jalali, Seyed Mohammad Jafar; Osorio, Gerardo J.; Ahmadian, Sajad; Lotfi, Mohamed; Campos, Vasco; Shafie-khah, Miadreza; Khosravi, Abbas; Catalao, Joao P. S.

A New Hybrid Deep Neural Architectural Search based Ensemble Reinforcement Learning Strategy for Wind Power Forecasting Technical Report

2021.

Links | BibTeX

1073.

Sharma, Arun K.; Verma, Nishchal K.

Guided Sampling-based Evolutionary Deep Neural Network for Intelligent Fault Diagnosis Journal Article

In: CoRR, vol. abs/2111.06885, 2021.

Links | BibTeX

1072.

Wu, Bichen; Li, Chaojian; Zhang, Hang; Dai, Xiaoliang; Zhang, Peizhao; Yu, Matthew; Wang, Jialiang; Lin, Yingyan; Vajda, Peter

FBNetV5: Neural Architecture Search for Multiple Tasks in One Run Technical Report

2021.

Links | BibTeX

1071.

He, Haoyu; Liu, Jing; Pan, Zizheng; Cai, Jianfei; Zhang, Jing; Tao, Dacheng; Zhuang, Bohan

Pruning Self-attentions into Convolutional Layers in Single Path Technical Report

2021.

Links | BibTeX

1070.

Jiang, Qian; Zhang, Xiaofan; Chen, Deming; Do, Minh N.; Yeh, Raymond A.

EH-DNAS: End-to-End Hardware-aware Differentiable Neural Architecture Search Technical Report

2021.

Links | BibTeX

1069.

Li, Chang; Zhang, Zhongzhen; Song, Rencheng; Cheng, Juan; Liu, Yu; Chen, Xun

EEG-based Emotion Recognition via Neural Architecture Search Journal Article

In: IEEE Transactions on Affective Computing, pp. 1-1, 2021.

Links | BibTeX

1068.

Mazumder, Arnab Neelim; Meng, Jian; Rashid, Hasib-Al; Kallakuri, Utteja; Zhang, Xin; Seo, Jae-Sun; Mohsenin, Tinoosh

A Survey on the Optimization of Neural Network Accelerators for Micro-AI On-Device Inference Journal Article

In: IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 11, no. 4, pp. 532-547, 2021.

Links | BibTeX

1067.

Wang, Ruixin; Jiang, Hongkai; Li, XingQiu; Yao, Pei

A Network Structure Search Method Based on Reinforcement Learning for Rolling Bearing Fault Diagnosis Proceedings Article

In: 2021 Global Reliability and Prognostics and Health Management (PHM-Nanjing), pp. 1-5, 2021.

Links | BibTeX

1066.

Huang, Tao; You, Shan; Wang, Fei; Qian, Chen; Zhang, Changshui; Wang, Xiaogang; Xu, Chang

GreedyNASv2: Greedier Search with a Greedy Path Filter Technical Report

2021.

Links | BibTeX

1065.

Sun, Zihao; Hu, Yu; Yang, Longxing; Lu, Shun; Mei, Jilin; Han, Yinhe; Li, Xiaowei

STC-NAS: Fast Neural Architecture Search with Source-Target Consistency Journal Article

In: Neurocomputing, 2021, ISSN: 0925-2312.

Abstract | Links | BibTeX

1064.

Sun, Zhenhong; Lin, Ming; Sun, Xiuyu; Tan, Zhiyu; Jin, Rong

Revisiting Efficient Object Detection Backbones from Zero-Shot Neural Architecture Search Technical Report

2021.

Links | BibTeX

1063.

Arican, Metin Ersin; Kara, Ozgur; Bredell, Gustav; Konukoglu, Ender

ISNAS-DIP: Image-Specific Neural Architecture Search for Deep Image Prior Proceedings Article

In: CVPR 2022, 2021.

Links | BibTeX

1062.

Zhang, Miao; Hu, Jilin; Su, Steven; Pan, Shirui; Chang, Xiaojun; Yang, Bin; Haffari, Gholamreza

BaLeNAS: Differentiable Architecture Search via the Bayesian Learning Rule Technical Report

2021.

Links | BibTeX

1061.

Ying, Guohao; He, Xin; Gao, Bin; Han, Bo; Chu, Xiaowen

EAGAN: Efficient Two-stage Evolutionary Architecture Search for GANs Technical Report

2021.

Links | BibTeX

1060.

Abbasi, Saad; Wong, Alexander; Shafiee, Mohammad Javad

MAPLE: Microprocessor A Priori for Latency Estimation Technical Report

2021.

Links | BibTeX

1059.

Qi, Hua; Wang, Zhijie; Guo, Qing; Chen, Jianlang; Juefei-Xu, Felix; Ma, Lei; Zhao, Jianjun

ArchRepair: Block-Level Architecture-Oriented Repairing for Deep Neural Networks Technical Report

2021.

Links | BibTeX

1058.

Xu, Jin; Chen, Mingjian; Huang, Jianqiang; Tang, Xingyuan; Hu, Ke; Li, Jian; Cheng, Jia; Lei, Jun

AutoHEnsGNN: Winning Solution to AutoGraph Challenge for KDD Cup 2020 Technical Report

2021.

Links | BibTeX

1057.

Zhou, Yuanding; Li, Baopu; Wang, Zhihui; Li, Haojie

Video Action Recognition with Neural Architecture Search Proceedings Article

In: Balasubramanian, Vineeth N.; Tsang, Ivor W. (Ed.): Asian Conference on Machine Learning, ACML 2021, 17-19 November 2021, Virtual Event, pp. 1675–1690, PMLR, 2021.

Links | BibTeX

1056.

Gala, Jay; Xie, Pengtao

Learning from Mistakes based on Class Weighting with Application to Neural Architecture Search Technical Report

2021.

Links | BibTeX

1055.

Zhu, Yichen; Du, Jie; Zhu, Yuqin; Wang, Yi; Ou, Zhicai; Feng, Feifei; Tang, Jian

Training BatchNorm Only in Neural Architecture Search and Beyond Technical Report

2021.

Links | BibTeX

1054.

Yang, Longxing; Hu, Yu; Lu, Shun; Sun, Zihao; Mei, Jilin; Zeng, Yiming; Shi, Zhiping; Han, Yinhe; Li, Xiaowei

DDSAS: Dynamic and Differentiable Space-Architecture Search Proceedings Article

In: Balasubramanian, Vineeth N.; Tsang, Ivor W. (Ed.): Asian Conference on Machine Learning, ACML 2021, 17-19 November 2021, Virtual Event, pp. 284–299, PMLR, 2021.

Links | BibTeX

1053.

Zhang, Ruisi; Liang, Youwei; Somayajula, Sai Ashish; Xie, Pengtao

Improving Differentiable Architecture Search with a Generative Model Technical Report

2021.

Links | BibTeX

3102 entries « 41 of 63 »