AutoML.org

Freiburg-Hannover

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


1352 entries « 2 of 28 »

2021

1302.

Zhan, Zheng; Gong, Yifan; Zhao, Pu; Yuan, Geng; Niu, Wei; Wu, Yushu; Zhang, Tianyun; Jayaweera, Malith; Kaeli, David R.; Ren, Bin; Lin, Xue; Wang, Yanzhi

Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search Technical Report

, 2021.

Links | BibTeX

1301.

Chitty-Venkata, Krishna Teja; Somani, Arun K.

Array-Aware Neural Architecture Search Inproceedings

In: 2021 IEEE 32nd International Conference on Application-specific Systems, Architectures and Processors (ASAP), pp. 125-132, 2021.

Links | BibTeX

1300.

Boutros, Fadi; Siebke, Patrick; Klemt, Marcel; Damer, Naser; Kirchbuchner, Florian; Kuijper, Arjan

PocketNet: Extreme Lightweight Face Recognition Network using Neural Architecture Search and Multi-Step Knowledge Distillation Technical Report

, 2021.

Links | BibTeX

1299.

Calisto, Maria Baldeon; Lai-Yuen, Susana K.

EMONAS-Net: Efficient multiobjective neural architecture search using surrogate-assisted evolutionary algorithm for 3D medical image segmentation Journal Article

In: Artificial Intelligence in Medicine, 119 , pp. 102154, 2021, ISSN: 0933-3657.

Abstract | Links | BibTeX

1298.

Peng, Jiefeng; Zhang, Jiqi; Li, Changlin; Wang, Guangrun; Liang, Xiaodan; Lin, Liang

Pi-NAS: Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift Technical Report

, 2021.

Links | BibTeX

1297.

Fan, Yi; Zhou, Quoqiang; Zhang, Weifeng; Bao, Shudi; Shen, Jun

Determining learning direction via multi-controller model for stably searching generative adversarial networks Journal Article

In: Neurocomputing, 464 , pp. 37-47, 2021, ISSN: 0925-2312.

Abstract | Links | BibTeX

1296.

Hou, Pengfei; Jin, Ying; Chen, Yukang

Single-DARTS: Towards Stable Architecture Search Technical Report

, 2021.

Links | BibTeX

1295.

Wang, Ruochen; Chen, Xiangning; Cheng, Minhao; Tang, Xiaocheng; Hsieh, Cho-Jui

RANK-NOSH: Efficient Predictor-Based Architecture Search via Non-Uniform Successive Halving Technical Report

, 2021.

Links | BibTeX

1294.

Ganepola, Vayangi Vishmi Vishara; Wirasingha, Torin

Generative Adversarial Networks Using Neural Architecture Search for Semantic Image Segmentation Inproceedings

In: 2021 IEEE 4th International Conference on Big Data and Artificial Intelligence (BDAI), pp. 236-241, 2021.

Links | BibTeX

1293.

Kim, Youngkee; Yun, Won Joon; Lee, Youn Kyu; Jung, Soyi; Kim, Joongheon

Trends in Neural Architecture Search: Towards the Acceleration of Search Technical Report

, 2021.

Links | BibTeX

1292.

Liu, Chia-Hsiang; Han, Yu-Shin; Sung, Yuan-Yao; Lee, Yi; Chiang, Hung-Yueh; Wu, Kai-Chiang

FOX-NAS: Fast, On-device and Explainable Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

1291.

Lyu, Bo; Yang, Yin; Wen, Shiping; Huang, Tingwen; Li, Ke

Neural Architecture Search for Portrait Parsing Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-10, 2021.

Links | BibTeX

1290.

Zhao, Pengyu; Xiao, Kecheng; Zhang, Yuanxing; Bian, Kaigui; Yan, Wei

AMEIR: Automatic Behavior Modeling, Interaction Exploration and MLP Investigation in the Recommender System Inproceedings

In: Zhou, Zhi-Hua (Ed.): Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, pp. 2104–2110, ijcai.org, 2021.

Links | BibTeX

1289.

Tang, Sheyang; Hosseini, Mahdi S.; Chen, Lina; Varma, Sonal; Rowsell, Corwyn; Damaskinos, Savvas; Plataniotis, Konstantinos N.; Wang, Zhou

Probeable DARTS with Application to Computational Pathology Technical Report

, 2021.

Links | BibTeX

1288.

Zhao, Changsheng; Hua, Ting; Shen, Yilin; Lou, Qian; Jin, Hongxia

Automatic Mixed-Precision Quantization Search of BERT Inproceedings

In: Zhou, Zhi-Hua (Ed.): Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, pp. 3427–3433, ijcai.org, 2021.

Links | BibTeX

1287.

Hosseini, Mahdi S.; Zhang, Jia Shu; Liu, Zhe; Fu, Andre; Su, Jingxuan; Tuli, Mathieu; Plataniotis, Konstantinos N.

CONet: Channel Optimization for Convolutional Neural Networks Technical Report

, 2021.

Links | BibTeX

1286.

Li, Yanxi; Yang, Zhaohui; Wang, Yunhe; Xu, Chang

Neural Architecture Dilation for Adversarial Robustness Technical Report

, 2021.

Links | BibTeX

1285.

Benmeziane, Hadjer; Maghraoui, Kaoutar El; Ouarnoughi, Hamza; Niar, Smaïl; Wistuba, Martin; Wang, Naigang

Hardware-Aware Neural Architecture Search: Survey and Taxonomy Inproceedings

In: Zhou, Zhi-Hua (Ed.): Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, pp. 4322–4329, ijcai.org, 2021.

Links | BibTeX

1284.

Chen, Boyu; Li, Peixia; Li, Baopu; Lin, Chen; Li, Chuming; Sun, Ming; Yan, Junjie; Ouyang, Wanli

BN-NAS: Neural Architecture Search with Batch Normalization Technical Report

, 2021.

Links | BibTeX

1283.

Razali, Mohd Norhisham; Moung, Ervin Gubin; Yahya, Farashazillah; Hou, Chong Joon; Hanapi, Rozita; Mohamed, Raihani; Hashem, Ibrahim Abakr Targio

Indigenous Food Recognition Model Based on Various Convolutional Neural Network Architectures for Gastronomic Tourism Business Analytics Journal Article

In: Inf., 12 (8), pp. 322, 2021.

Links | BibTeX

1282.

Geiping, Jonas; Lukasik, Jovita; Keuper, Margret; Moeller, Michael

DARTS for Inverse Problems: a Study on Hyperparameter Sensitivity Journal Article

In: CoRR, abs/2108.05647 , 2021.

Links | BibTeX

1281.

Wang, Xin; Zhu, Wenwu

Automated Machine Learning on Graph Inproceedings

In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pp. 4082–4083, Association for Computing Machinery, Virtual Event, Singapore, 2021, ISBN: 9781450383325.

Abstract | Links | BibTeX

1280.

Li, Jihao; Weinmann, Martin; Sun, Xian; Diao, Wenhui; Feng, Yingchao; Fu, Kun

Random Topology and Random Multiscale Mapping: An Automated Design of Multiscale and Lightweight Neural Network for Remote-Sensing Image Recognition Journal Article

In: IEEE Transactions on Geoscience and Remote Sensing, pp. 1-17, 2021.

Links | BibTeX

1279.

Ding, Yuhui; Yao, Quanming; Zhao, Huan; Zhang, Tong

DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks Inproceedings

In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pp. 279–288, Association for Computing Machinery, Virtual Event, Singapore, 2021, ISBN: 9781450383325.

Abstract | Links | BibTeX

1278.

Shim, Jae-hun; Kang, Suk-ju

Neural Architecture Search for Light-weight Multi-touch Classification Inproceedings

In: 2021 36th International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC), pp. 1-3, 2021.

Links | BibTeX

1277.

Xu, Hang; Kang, Ning; Zhang, Gengwei; Xie, Chuanlong; Liang, Xiaodan; Li, Zhenguo

NASOA: Towards Faster Task-oriented Online Fine-tuning with a Zoo of Models Technical Report

, 2021.

Links | BibTeX

1276.

Vieira, Carlos; Cáceres, Leslie Pérez; Bezerra, Leonardo C T

Evaluating Anytime Performance on NAS-Bench-101 Inproceedings

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 1249-1256, 2021.

Links | BibTeX

1275.

Andersen, Hayden; Stevenson, Sean; Ha, Tuan; Gao, Xiaoying; Xue, Bing

Evolving Neural Networks for Text Classification using Genetic Algorithm-based Approaches Inproceedings

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 1241-1248, 2021.

Links | BibTeX

1274.

Huang, Junhao; Xue, Bing; Sun, Yanan; Zhang, Mengjie

A Flexible Variable-length Particle Swarm Optimization Approach to Convolutional Neural Network Architecture Design Inproceedings

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 934-941, 2021.

Links | BibTeX

1273.

Zhang, Yuge; Yan, Chenqian; Zhang, Quanlu; Zhang, Li Lyna; Yang, Yaming; Gao, Xiaotian; Yang, Yuqing

AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing Technical Report

, 2021.

Links | BibTeX

1272.

Zhao, Liang; Fang, Wei

An Efficient and Flexible Automatic Search Algorithm for Convolution Network Architectures Inproceedings

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 2203-2210, 2021.

Links | BibTeX

1271.

Namekawa, Shizuma; Tezuka, Taro

Evolutionary Neural Architecture Search by Mutual Information Analysis Inproceedings

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 966-972, 2021.

Links | BibTeX

1270.

Cai, Ronghong; Luo, Jianping

Multi-Task Learning for Multi-Objective Evolutionary Neural Architecture Search Inproceedings

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 1680-1687, 2021.

Links | BibTeX

1269.

Shi, Rui; Luo, Jianping; Liu, Qiqi

Fast Evolutionary Neural Architecture Search Based on Bayesian Surrogate Model Inproceedings

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 1217-1224, 2021.

Links | BibTeX

1268.

Zhou, Xun; Qin, A K; Sun, Yanan; Tan, Kay Chen

A Survey of Advances in Evolutionary Neural Architecture Search Inproceedings

In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 950-957, 2021.

Links | BibTeX

1267.

Xie, Xiangning; Liu, Yuqiao; Sun, Yanan; Yen, Gary G; Xue, Bing; Zhang, Mengjie

BenchENAS: A Benchmarking Platform for Evolutionary Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

1266.

Yang, Shangshang; Tian, Ye; Xiang, Xiaoshu; Peng, Shichen; Zhang, Xingyi

Accelerating Evolutionary Neural Architecture Search via Multi-Fidelity Evaluation Technical Report

, 2021.

Links | BibTeX

1265.

Repin, Denis; Petrov, Tatjana

Automated Deep Abstractions for Stochastic Chemical Reaction Networks Journal Article

In: Information and Computation, pp. 104788, 2021, ISSN: 0890-5401.

Abstract | Links | BibTeX

1264.

Zhang, Yongan; Fu, Yonggan; Jiang, Weiwen; Li, Chaojian; You, Haoran; Li, Meng; Chandra, Vikas; Lin, Yingyan

DIAN: Differentiable Accelerator-Network Co-Search Towards Maximal DNN Efficiency Inproceedings

In: 2021 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED), pp. 1-6, 2021.

Links | BibTeX

1263.

Li, Yuhong; Hao, Cong; Li, Pan; Xiong, Jinjun; Chen, Deming

Generic Neural Architecture Search via Regression Technical Report

, 2021.

Links | BibTeX

1262.

Odema, Mohanad; Rashid, Nafiul; Faruque, Mohammad Abdullah Al

EExNAS: Early-Exit Neural Architecture Search Solutions for Low-Power Wearable Devices Inproceedings

In: 2021 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED), pp. 1-6, 2021.

Links | BibTeX

1261.

Li, Qing; Zhang, Wei; Zhao, Lin; Wu, Xia; Liu, Tianming

Evolutional Neural Architecture Search for Optimization of Spatiotemporal Brain Network Decomposition Journal Article

In: IEEE Transactions on Biomedical Engineering, pp. 1-1, 2021.

Links | BibTeX

1260.

He, Xiaoyu; Wang, Yong; Wang, Xiaojing; Huang, Weihong; Zhao, Shuang; Chen, Xiang

Simple-Encoded Evolving Convolutional Neural Networks and Its Application to Skin Disease Image Classification Journal Article

In: Swarm and Evolutionary Computation, pp. 100955, 2021, ISSN: 2210-6502.

Abstract | Links | BibTeX

1259.

Mok, Jisoo; Na, Byunggook; Choe, Hyeokjun; Yoon, Sungroh

AdvRush: Searching for Adversarially Robust Neural Architectures Technical Report

, 2021.

Links | BibTeX

1258.

Liu, Jing; Zhuang, Bohan; Tan, Mingkui; Liu, Xu; Phung, Dinh; Li, Yuanqing; Cai, Jianfei

Elastic Architecture Search for Diverse Tasks with Different Resources Technical Report

, 2021.

Links | BibTeX

1257.

Xie, Zhenyu; Zhang, Xujie; Zhao, Fuwei; Dong, Haoye; Kampffmeyer, Michael C; Yan, Haonan; Liang, Xiaodan

WAS-VTON: Warping Architecture Search for Virtual Try-on Network Technical Report

, 2021.

Links | BibTeX

1256.

Mills, Keith G; Salameh, Mohammad; Niu, Di; Han, Fred X; Rezaei, Seyed Saeed Changiz; Yao, Hengshuai; Lu, Wei; Lian, Shuo; Jui, Shangling

Exploring Neural Architecture Search Space via Deep Deterministic Sampling Journal Article

In: IEEE Access, 9 , pp. 110962-110974, 2021.

Links | BibTeX

1255.

Li, Guihong; Mandal, Sumit K; Ü,; Marculescu, Radu

FLASH: Fast Neural Architecture Search with Hardware Optimization Technical Report

, 2021.

Links | BibTeX

1254.

Broni-Bediako, Clifford; Murata, Yuki; Mormille, Luiz H B; Atsumi, Masayasu

Searching for CNN Architectures for Remote Sensing Scene Classification Journal Article

In: IEEE Transactions on Geoscience and Remote Sensing, pp. 1-13, 2021.

Links | BibTeX

1253.

Liu, Yuqiao; Tang, Yehui; Sun, Yanan

Homogeneous Architecture Augmentation for Neural Predictor Journal Article

In: CoRR, abs/2107.13153 , 2021.

Links | BibTeX

1352 entries « 2 of 28 »