AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3157 entries « 38 of 64 »

2021

1307.

Chen, Lei; Yuan, Fajie; Yang, Jiaxi; Yang, Min; Li, Chengming

Scene-adaptive Knowledge Distillation for Sequential Recommendation via Differentiable Architecture Search Technical Report

2021.

Links | BibTeX

1306.

Liu, Zhu; Ma, Long; Liu, Risheng; Fan, Xin

Learning to Discover a Unified Architecture for Low-Level Vision Journal Article

In: IEEE Signal Processing Letters, vol. 28, pp. 1470-1474, 2021.

Links | BibTeX

1305.

Gao, Jiahui; Xu, Hang; Shi, Han; Ren, Xiaozhe; Yu, Philip L H; Liang, Xiaodan; Jiang, Xin; Li, Zhenguo

AutoBERT-Zero: Evolving BERT Backbone from Scratch Technical Report

2021.

Links | BibTeX

1304.

Chrostoforidis, Aristeidis; Kyriakides, George; Margaritis, Konstantinos G

A Novel Evolutionary Algorithm for Hierarchical Neural Architecture Search Technical Report

2021.

Links | BibTeX

1303.

Odema, Mohanad; Rashid, Nafiul; Demirel, Berken Utku; Faruque, Mohammad Abdullah Al

LENS: Layer Distribution Enabled Neural Architecture Search in Edge-Cloud Hierarchies Technical Report

2021.

Links | BibTeX

1302.

Roth, Holger R; Yang, Dong; Li, Wenqi; Myronenko, Andriy; Zhu, Wentao; Xu, Ziyue; Wang, Xiaosong; Xu, Daguang

Federated Whole Prostate Segmentation in MRI with Personalized Neural Architectures Technical Report

2021.

Links | BibTeX

1301.

Louati, Hassen; Bechikh, Slim; Louati, Ali; Aldaej, Abdulaziz; Said, Lamjed Ben

Evolutionary Optimization of Convolutional Neural Network Architecture Design for Thoracic X-Ray Image Classification Proceedings Article

In: Fujita, Hamido; Selamat, Ali; -, Jerry Chun; Ali, Moonis (Ed.): Advances and Trends in Artificial Intelligence. Artificial Intelligence Practices - 34th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2021, Kuala Lumpur, Malaysia, July 26-29, 2021, Proceedings, Part I, pp. 121–132, Springer, 2021.

Links | BibTeX

1300.

Thuy, Hang Duong Thi; Minh, Tuan Nguyen; Van, Phi Nguyen; Quoc, Long Tran

Fully Automated Machine Learning Pipeline for Echocardiogram Segmentation Technical Report

2021.

Links | BibTeX

1299.

Zhang, Peng; Tang, Jinsong; Zhong, Heping; Ning, Mingqiang; Liu, Dandan; Wu, Ke

Self-Trained Target Detection of Radar and Sonar Images Using Automatic Deep Learning Journal Article

In: IEEE Transactions on Geoscience and Remote Sensing, pp. 1-14, 2021.

Links | BibTeX

1298.

Xue, Yu; Wang, Yankang; Liang, Jiayu; Slowik, Adam

A Self-Adaptive Mutation Neural Architecture Search Algorithm Based on Blocks Journal Article

In: IEEE Computational Intelligence Magazine, vol. 16, no. 3, pp. 67-78, 2021.

Links | BibTeX

1297.

Phan, Quan Minh; Luong, Ngoc Hoang

Enhancing Multi-objective Evolutionary Neural Architecture Search with Surrogate Models and Potential Point-Guided Local Searches Proceedings Article

In: Fujita, Hamido; Selamat, Ali; Lin, Jerry Chun-Wei; Ali, Moonis (Ed.): pp. 460–472, Springer International Publishing, Cham, 2021, ISBN: 978-3-030-79457-6.

Abstract | Links | BibTeX

1296.

Xue, Song; Chen, Hanlin; Xie, Chunyu; Zhang, Baochang; Gong, Xuan; Doermann, David

Fast and Unsupervised Neural Architecture Evolution for Visual Representation Learning Journal Article

In: IEEE Computational Intelligence Magazine, vol. 16, no. 3, pp. 22-32, 2021.

Links | BibTeX

1295.

Do, Tu; Luong, Ngoc Hoang

Insightful and Practical Multi-objective Convolutional Neural Network Architecture Search with Evolutionary Algorithms Proceedings Article

In: Fujita, Hamido; Selamat, Ali; Lin, Jerry Chun-Wei; Ali, Moonis (Ed.): pp. 473–479, Springer International Publishing, Cham, 2021, ISBN: 978-3-030-79457-6.

Abstract | Links | BibTeX

1294.

Dey, Debadeepta; Shah, Shital; Bubeck, Sebastien

Ranking Architectures by Feature Extraction Capabilities Proceedings Article

In: 8th ICML Workshop on Automated Machine Learning (AutoML), 2021.

Links | BibTeX

1293.

Ma, Jingchen; He, Ni; Yoon, Jin H; Ha, Richard; Li, Jiao; Ma, Weimei; Meng, Tiebao; Lu, Lin; Schwartz, Lawrence H; Wu, Yaopan; Ye, Zhaoxiang; Wu, Peihong; Zhao, Binsheng; Xie, Chuanmiao

Distinguishing benign and malignant lesions on contrast-enhanced breast cone-beam CT with deep learning neural architecture search Journal Article

In: European Journal of Radiology, vol. 142, pp. 109878, 2021, ISSN: 0720-048X.

Abstract | Links | BibTeX

1292.

Luo, Xiangzhong; Liu, Di; Huai, Shuo; Kong, Hao; Chen, Hui; Liu, Weichen

Designing Efficient DNNs via Hardware-Aware Neural Architecture Search and Beyond Journal Article

In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2021.

Links | BibTeX

1291.

Gracheva, Ekaterina

Trainless model performance estimation based on random weights initialisations for neural architecture search Journal Article

In: Array, vol. 12, pp. 100082, 2021, ISSN: 2590-0056.

Abstract | Links | BibTeX

1290.

Chakraborty, Biswadeep; Mukhopadhyay, Saibal

textdollar(mu)textdollarDARTS: Model Uncertainty-Aware Differentiable Architecture Search Technical Report

2021.

Links | BibTeX

1289.

Yin, Yichun; Chen, Cheng; Shang, Lifeng; Jiang, Xin; Chen, Xiao; Liu, Qun

AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models Proceedings Article

In: Zong, Chengqing; Xia, Fei; Li, Wenjie; Navigli, Roberto (Ed.): Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021, pp. 5146–5157, Association for Computational Linguistics, 2021.

Links | BibTeX

1288.

Termritthikun, Chakkrit; Jamtsho, Yeshi; Ieamsaard, Jirarat; Muneesawang, Paisarn; Lee, Ivan

EEEA-Net: An Early Exit Evolutionary Neural Architecture Search Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 104, pp. 104397, 2021, ISSN: 0952-1976.

Abstract | Links | BibTeX

1287.

Du, Quan; Xu, Nuo; Li, Yinqiao; Xiao, Tong; Zhu, Jingbo

Topology-Sensitive Neural Architecture Search for Language Modeling Journal Article

In: IEEE Access, vol. 9, pp. 107416-107423, 2021.

Links | BibTeX

1286.

Liu, Yuqiao; Tang, Yehui; Sun, Yanan

Homogeneous Architecture Augmentation for Neural Predictor Journal Article

In: CoRR, vol. abs/2107.13153, 2021.

Links | BibTeX

1285.

Broni-Bediako, Clifford; Murata, Yuki; Mormille, Luiz H B; Atsumi, Masayasu

Searching for CNN Architectures for Remote Sensing Scene Classification Journal Article

In: IEEE Transactions on Geoscience and Remote Sensing, pp. 1-13, 2021.

Links | BibTeX

1284.

Li, Guihong; Mandal, Sumit K; Ü,; Marculescu, Radu

FLASH: Fast Neural Architecture Search with Hardware Optimization Technical Report

2021.

Links | BibTeX

1283.

Mills, Keith G; Salameh, Mohammad; Niu, Di; Han, Fred X; Rezaei, Seyed Saeed Changiz; Yao, Hengshuai; Lu, Wei; Lian, Shuo; Jui, Shangling

Exploring Neural Architecture Search Space via Deep Deterministic Sampling Journal Article

In: IEEE Access, vol. 9, pp. 110962-110974, 2021.

Links | BibTeX

1282.

Xie, Zhenyu; Zhang, Xujie; Zhao, Fuwei; Dong, Haoye; Kampffmeyer, Michael C; Yan, Haonan; Liang, Xiaodan

WAS-VTON: Warping Architecture Search for Virtual Try-on Network Technical Report

2021.

Links | BibTeX

1281.

Liu, Jing; Zhuang, Bohan; Tan, Mingkui; Liu, Xu; Phung, Dinh; Li, Yuanqing; Cai, Jianfei

Elastic Architecture Search for Diverse Tasks with Different Resources Technical Report

2021.

Links | BibTeX

1280.

Mok, Jisoo; Na, Byunggook; Choe, Hyeokjun; Yoon, Sungroh

AdvRush: Searching for Adversarially Robust Neural Architectures Technical Report

2021.

Links | BibTeX

1279.

He, Xiaoyu; Wang, Yong; Wang, Xiaojing; Huang, Weihong; Zhao, Shuang; Chen, Xiang

Simple-Encoded Evolving Convolutional Neural Networks and Its Application to Skin Disease Image Classification Journal Article

In: Swarm and Evolutionary Computation, pp. 100955, 2021, ISSN: 2210-6502.

Abstract | Links | BibTeX

1278.

Li, Qing; Zhang, Wei; Zhao, Lin; Wu, Xia; Liu, Tianming

Evolutional Neural Architecture Search for Optimization of Spatiotemporal Brain Network Decomposition Journal Article

In: IEEE Transactions on Biomedical Engineering, pp. 1-1, 2021.

Links | BibTeX

1277.

Odema, Mohanad; Rashid, Nafiul; Faruque, Mohammad Abdullah Al

EExNAS: Early-Exit Neural Architecture Search Solutions for Low-Power Wearable Devices Proceedings Article

In: 2021 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED), pp. 1-6, 2021.

Links | BibTeX

1276.

Li, Yuhong; Hao, Cong; Li, Pan; Xiong, Jinjun; Chen, Deming

Generic Neural Architecture Search via Regression Technical Report

2021.

Links | BibTeX

1275.

Zhang, Yongan; Fu, Yonggan; Jiang, Weiwen; Li, Chaojian; You, Haoran; Li, Meng; Chandra, Vikas; Lin, Yingyan

DIAN: Differentiable Accelerator-Network Co-Search Towards Maximal DNN Efficiency Proceedings Article

In: 2021 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED), pp. 1-6, 2021.

Links | BibTeX

1274.

Repin, Denis; Petrov, Tatjana

Automated Deep Abstractions for Stochastic Chemical Reaction Networks Journal Article

In: Information and Computation, pp. 104788, 2021, ISSN: 0890-5401.

Abstract | Links | BibTeX

1273.

Yang, Shangshang; Tian, Ye; Xiang, Xiaoshu; Peng, Shichen; Zhang, Xingyi

Accelerating Evolutionary Neural Architecture Search via Multi-Fidelity Evaluation Technical Report

2021.

Links | BibTeX

1272.

Xie, Xiangning; Liu, Yuqiao; Sun, Yanan; Yen, Gary G; Xue, Bing; Zhang, Mengjie

BenchENAS: A Benchmarking Platform for Evolutionary Neural Architecture Search Technical Report

2021.

Links | BibTeX

1271.

Zhou, Xun; Qin, A K; Sun, Yanan; Tan, Kay Chen

A Survey of Advances in Evolutionary Neural Architecture Search Proceedings Article

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 950-957, 2021.

Links | BibTeX

1270.

Shi, Rui; Luo, Jianping; Liu, Qiqi

Fast Evolutionary Neural Architecture Search Based on Bayesian Surrogate Model Proceedings Article

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 1217-1224, 2021.

Links | BibTeX

1269.

Cai, Ronghong; Luo, Jianping

Multi-Task Learning for Multi-Objective Evolutionary Neural Architecture Search Proceedings Article

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 1680-1687, 2021.

Links | BibTeX

1268.

Namekawa, Shizuma; Tezuka, Taro

Evolutionary Neural Architecture Search by Mutual Information Analysis Proceedings Article

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 966-972, 2021.

Links | BibTeX

1267.

Zhao, Liang; Fang, Wei

An Efficient and Flexible Automatic Search Algorithm for Convolution Network Architectures Proceedings Article

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 2203-2210, 2021.

Links | BibTeX

1266.

Zhang, Yuge; Yan, Chenqian; Zhang, Quanlu; Zhang, Li Lyna; Yang, Yaming; Gao, Xiaotian; Yang, Yuqing

AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing Technical Report

2021.

Links | BibTeX

1265.

Huang, Junhao; Xue, Bing; Sun, Yanan; Zhang, Mengjie

A Flexible Variable-length Particle Swarm Optimization Approach to Convolutional Neural Network Architecture Design Proceedings Article

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 934-941, 2021.

Links | BibTeX

1264.

Andersen, Hayden; Stevenson, Sean; Ha, Tuan; Gao, Xiaoying; Xue, Bing

Evolving Neural Networks for Text Classification using Genetic Algorithm-based Approaches Proceedings Article

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 1241-1248, 2021.

Links | BibTeX

1263.

Vieira, Carlos; Cáceres, Leslie Pérez; Bezerra, Leonardo C T

Evaluating Anytime Performance on NAS-Bench-101 Proceedings Article

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 1249-1256, 2021.

Links | BibTeX

1262.

Xu, Hang; Kang, Ning; Zhang, Gengwei; Xie, Chuanlong; Liang, Xiaodan; Li, Zhenguo

NASOA: Towards Faster Task-oriented Online Fine-tuning with a Zoo of Models Technical Report

2021.

Links | BibTeX

1261.

Shim, Jae-hun; Kang, Suk-ju

Neural Architecture Search for Light-weight Multi-touch Classification Proceedings Article

In: 2021 36th International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC), pp. 1-3, 2021.

Links | BibTeX

1260.

Ding, Yuhui; Yao, Quanming; Zhao, Huan; Zhang, Tong

DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks Proceedings Article

In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pp. 279–288, Association for Computing Machinery, Virtual Event, Singapore, 2021, ISBN: 9781450383325.

Abstract | Links | BibTeX

1259.

Li, Jihao; Weinmann, Martin; Sun, Xian; Diao, Wenhui; Feng, Yingchao; Fu, Kun

Random Topology and Random Multiscale Mapping: An Automated Design of Multiscale and Lightweight Neural Network for Remote-Sensing Image Recognition Journal Article

In: IEEE Transactions on Geoscience and Remote Sensing, pp. 1-17, 2021.

Links | BibTeX

1258.

Wang, Xin; Zhu, Wenwu

Automated Machine Learning on Graph Proceedings Article

In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pp. 4082–4083, Association for Computing Machinery, Virtual Event, Singapore, 2021, ISBN: 9781450383325.

Abstract | Links | BibTeX

3157 entries « 38 of 64 »