AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3157 entries « 39 of 64 »

2021

1257.

Geiping, Jonas; Lukasik, Jovita; Keuper, Margret; Moeller, Michael

DARTS for Inverse Problems: a Study on Hyperparameter Sensitivity Journal Article

In: CoRR, vol. abs/2108.05647, 2021.

Links | BibTeX

1256.

Razali, Mohd Norhisham; Moung, Ervin Gubin; Yahya, Farashazillah; Hou, Chong Joon; Hanapi, Rozita; Mohamed, Raihani; Hashem, Ibrahim Abakr Targio

Indigenous Food Recognition Model Based on Various Convolutional Neural Network Architectures for Gastronomic Tourism Business Analytics Journal Article

In: Inf., vol. 12, no. 8, pp. 322, 2021.

Links | BibTeX

1255.

Chen, Boyu; Li, Peixia; Li, Baopu; Lin, Chen; Li, Chuming; Sun, Ming; Yan, Junjie; Ouyang, Wanli

BN-NAS: Neural Architecture Search with Batch Normalization Technical Report

2021.

Links | BibTeX

1254.

Benmeziane, Hadjer; Maghraoui, Kaoutar El; Ouarnoughi, Hamza; Niar, Smaïl; Wistuba, Martin; Wang, Naigang

Hardware-Aware Neural Architecture Search: Survey and Taxonomy Proceedings Article

In: Zhou, Zhi-Hua (Ed.): Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, pp. 4322–4329, ijcai.org, 2021.

Links | BibTeX

1253.

Li, Yanxi; Yang, Zhaohui; Wang, Yunhe; Xu, Chang

Neural Architecture Dilation for Adversarial Robustness Technical Report

2021.

Links | BibTeX

1252.

Hosseini, Mahdi S.; Zhang, Jia Shu; Liu, Zhe; Fu, Andre; Su, Jingxuan; Tuli, Mathieu; Plataniotis, Konstantinos N.

CONet: Channel Optimization for Convolutional Neural Networks Technical Report

2021.

Links | BibTeX

1251.

Zhao, Changsheng; Hua, Ting; Shen, Yilin; Lou, Qian; Jin, Hongxia

Automatic Mixed-Precision Quantization Search of BERT Proceedings Article

In: Zhou, Zhi-Hua (Ed.): Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, pp. 3427–3433, ijcai.org, 2021.

Links | BibTeX

1250.

Tang, Sheyang; Hosseini, Mahdi S.; Chen, Lina; Varma, Sonal; Rowsell, Corwyn; Damaskinos, Savvas; Plataniotis, Konstantinos N.; Wang, Zhou

Probeable DARTS with Application to Computational Pathology Technical Report

2021.

Links | BibTeX

1249.

Zhao, Pengyu; Xiao, Kecheng; Zhang, Yuanxing; Bian, Kaigui; Yan, Wei

AMEIR: Automatic Behavior Modeling, Interaction Exploration and MLP Investigation in the Recommender System Proceedings Article

In: Zhou, Zhi-Hua (Ed.): Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, pp. 2104–2110, ijcai.org, 2021.

Links | BibTeX

1248.

Lyu, Bo; Yang, Yin; Wen, Shiping; Huang, Tingwen; Li, Ke

Neural Architecture Search for Portrait Parsing Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-10, 2021.

Links | BibTeX

1247.

Liu, Chia-Hsiang; Han, Yu-Shin; Sung, Yuan-Yao; Lee, Yi; Chiang, Hung-Yueh; Wu, Kai-Chiang

FOX-NAS: Fast, On-device and Explainable Neural Architecture Search Technical Report

2021.

Links | BibTeX

1246.

Kim, Youngkee; Yun, Won Joon; Lee, Youn Kyu; Jung, Soyi; Kim, Joongheon

Trends in Neural Architecture Search: Towards the Acceleration of Search Technical Report

2021.

Links | BibTeX

1245.

Ganepola, Vayangi Vishmi Vishara; Wirasingha, Torin

Generative Adversarial Networks Using Neural Architecture Search for Semantic Image Segmentation Proceedings Article

In: 2021 IEEE 4th International Conference on Big Data and Artificial Intelligence (BDAI), pp. 236-241, 2021.

Links | BibTeX

1244.

Wang, Ruochen; Chen, Xiangning; Cheng, Minhao; Tang, Xiaocheng; Hsieh, Cho-Jui

RANK-NOSH: Efficient Predictor-Based Architecture Search via Non-Uniform Successive Halving Proceedings Article

In: ICCV 2021, 2021.

Links | BibTeX

1243.

Hou, Pengfei; Jin, Ying; Chen, Yukang

Single-DARTS: Towards Stable Architecture Search Technical Report

2021.

Links | BibTeX

1242.

Fan, Yi; Zhou, Quoqiang; Zhang, Weifeng; Bao, Shudi; Shen, Jun

Determining learning direction via multi-controller model for stably searching generative adversarial networks Journal Article

In: Neurocomputing, vol. 464, pp. 37-47, 2021, ISSN: 0925-2312.

Abstract | Links | BibTeX

1241.

Peng, Jiefeng; Zhang, Jiqi; Li, Changlin; Wang, Guangrun; Liang, Xiaodan; Lin, Liang

Pi-NAS: Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift Technical Report

2021.

Links | BibTeX

1240.

Calisto, Maria Baldeon; Lai-Yuen, Susana K.

EMONAS-Net: Efficient multiobjective neural architecture search using surrogate-assisted evolutionary algorithm for 3D medical image segmentation Journal Article

In: Artificial Intelligence in Medicine, vol. 119, pp. 102154, 2021, ISSN: 0933-3657.

Abstract | Links | BibTeX

1239.

Boutros, Fadi; Siebke, Patrick; Klemt, Marcel; Damer, Naser; Kirchbuchner, Florian; Kuijper, Arjan

PocketNet: Extreme Lightweight Face Recognition Network using Neural Architecture Search and Multi-Step Knowledge Distillation Technical Report

2021.

Links | BibTeX

1238.

Chitty-Venkata, Krishna Teja; Somani, Arun K.

Array-Aware Neural Architecture Search Proceedings Article

In: 2021 IEEE 32nd International Conference on Application-specific Systems, Architectures and Processors (ASAP), pp. 125-132, 2021.

Links | BibTeX

1237.

Zhan, Zheng; Gong, Yifan; Zhao, Pu; Yuan, Geng; Niu, Wei; Wu, Yushu; Zhang, Tianyun; Jayaweera, Malith; Kaeli, David R.; Ren, Bin; Lin, Xue; Wang, Yanzhi

Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search Technical Report

2021.

Links | BibTeX

1236.

Wei, Lanning; Zhao, Huan; Yao, Quanming; He, Zhiqiang

Pooling Architecture Search for Graph Classification Technical Report

2021.

Links | BibTeX

1235.

Heuillet, Alexandre; Tabia, Hedi; Arioui, Hichem; Youcef-Toumi, Kamal

D-DARTS: Distributed Differentiable Architecture Search Technical Report

2021.

Links | BibTeX

1234.

Hsieh, Jun-Wei; Chang, Ming-Ching; Chen, Ping-Yang; Santra, Santanu; Chou, Cheng-Han; Huang, Chih-Sheng

MS-DARTS: Mean-Shift Based Differentiable Architecture Search Technical Report

2021.

Links | BibTeX

1233.

Chitty-Venkata, Krishna Teja; Somani, Arun K.; Kothandaraman, Sreenivas

Searching Architecture and Precision for U-net based Image Restoration Tasks Proceedings Article

In: 2021 IEEE International Conference on Image Processing (ICIP), pp. 1989-1993, 2021.

Links | BibTeX

1232.

Traore, Kalifou Rene; Camero, Andrés; Zhu, Xiao Xiang

Lessons from the Clustering Analysis of a Search Space: A Centroid-based Approach to Initializing NAS Technical Report

2021.

Links | BibTeX

1231.

Shi, Pengfei; Zhao, Zhongxin; Fan, Xinnan; Yan, Xijun; Yan, Wei; Xin, Yuanxue

Remote Sensing Image Object Detection Based on Angle Classification Journal Article

In: IEEE Access, vol. 9, pp. 118696-118707, 2021.

Links | BibTeX

1230.

Lin, Jun-Liang; Sung, Yi-Lin; Hong, Cheng-Yao; Lee, Han-Hung; Liu, Tyng-Luh

The Maximum a Posterior Estimation of Darts Proceedings Article

In: 2021 IEEE International Conference on Image Processing (ICIP), pp. 419-423, 2021.

Links | BibTeX

1229.

Huynh, Lam; Nguyen, Phong; Matas, Jiri; Rahtu, Esa; Heikkilä, Janne

Lightweight Monocular Depth with a Novel Neural Architecture Search Method Technical Report

2021.

Links | BibTeX

1228.

Chen, Wuyang; Gong, Xinyu; Wei, Yunchao; Shi, Humphrey; Yan, Zhicheng; Yang, Yi; Wang, Zhangyang

Understanding and Accelerating Neural Architecture Search with Training-Free and Theory-Grounded Metrics Technical Report

2021.

Links | BibTeX

1227.

Zhang, Yang; Zong, Ruohan; Kou, Ziyi; Shang, Lanyu; Wang, Dong

A Crowd-driven Dynamic Neural Architecture Searching Approach to Quality-aware Streaming Disaster Damage Assessment Technical Report

2021.

Links | BibTeX

1226.

Wang, Huiqun; Yang, Ruijie; Huang, Di; Wang, Yunhong

iDARTS: Improving DARTS by Node Normalization and Decorrelation Discretization Technical Report

2021.

Links | BibTeX

1225.

Lyu, Bo; Wen, Shiping; Shi, Kaibo; Huang, Tingwen

Multiobjective Reinforcement Learning-Based Neural Architecture Search for Efficient Portrait Parsing Journal Article

In: IEEE Transactions on Cybernetics, pp. 1-12, 2021.

Links | BibTeX

1224.

Xu, Jin; Tan, Xu; Song, Kaitao; Luo, Renqian; Leng, Yichong; Qin, Tao; Liu, Tie-Yan; Li, Jian

Analyzing and Mitigating Interference in Neural Architecture Search Technical Report

2021.

Links | BibTeX

1223.

Du, Mingyang; He, Xikai; Cai, Xiaohao; Bi, Daping

Balanced Neural Architecture Search and Its Application in Specific Emitter Identification Journal Article

In: IEEE Transactions on Signal Processing, vol. 69, pp. 5051-5065, 2021.

Links | BibTeX

1222.

Huynh, Lam; Nguyen, Tri; Nguyen, Thu; Pirttikangas, Susanna; Siirtola, Pekka

StressNAS: Affect State and Stress Detection Using Neural Architecture Search Proceedings Article

In: Doryab, Afsaneh; Lv, Qin; Beigl, Michael (Ed.): UbiComp/ISWC '21: 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2021 ACM International Symposium on Wearable Computers, Virtual Event, September 21-25, 2021, pp. 121–125, ACM, 2021.

Links | BibTeX

1221.

Liu, Zuhao; Wang, Huan; Gao, Yibo; Shi, Shunchen

Automatic Attention Learning Using Neural Architecture Search for Detection of Cardiac Abnormality in 12-Lead ECG Journal Article

In: IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1-12, 2021.

Links | BibTeX

1220.

Liu, Zhijian; Tang, Haotian; Zhao, Shengyu; Shao, Kevin; Han, Song

PVNAS: 3D Neural Architecture Search with Point-Voxel Convolution Journal Article

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-1, 2021.

Links | BibTeX

1219.

Li, Yuening; Chen, Zhengzhang; Zha, Daochen; Zhou, Kaixiong; Jin, Haifeng; Chen, Haifeng; Hu, Xia

Automated Anomaly Detection via Curiosity-Guided Search and Self-Imitation Learning Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-13, 2021.

Links | BibTeX

1218.

Nie, Xing; Liu, Yongcheng; Chen, Shaohong; Chang, Jianlong; Huo, Chunlei; Meng, Gaofeng; Tian, Qi; Hu, Weiming; Pan, Chunhong

Differentiable Convolution Search for Point Cloud Processing Technical Report

2021.

Links | BibTeX

1217.

Xue, Song; Zhao, Bo; Chen, Hanlin; Wang, Runqi; Zhang, Baochang

UCB-ENAS based on Reinforcement Learning Proceedings Article

In: 2021 IEEE 16th Conference on Industrial Electronics and Applications (ICIEA), pp. 2008-2013, 2021.

Links | BibTeX

1216.

Yu, Kaicheng; Ranftl, Rene; Salzmann, Mathieu

An Analysis of Super-Net Heuristics in Weight-Sharing NAS Journal Article

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-1, 2021.

Links | BibTeX

1215.

Gong, Xinyu; Wang, Heng; Shou, Zheng; Feiszli, Matt; Wang, Zhangyang; Yan, Zhicheng

Searching for Two-Stream Models in Multivariate Space for Video Recognition Technical Report

2021.

Links | BibTeX

1214.

Deng, Jiajun; Gutierrez, Fabian Ritter; Hu, Shoukang; Geng, Mengzhe; Xie, Xurong; Ye, Zi; Liu, Shansong; Yu, Jianwei; Liu, Xunying; Meng, Helen

Bayesian Parametric and Architectural Domain Adaptation of LF-MMI Trained TDNNs for Elderly and Dysarthric Speech Recognition Proceedings Article

In: Proc. Interspeech 2021, pp. 4818–4822, 2021.

Links | BibTeX

1213.

Shu, Yao; Cai, Shaofeng; Dai, Zhongxiang; Ooi, Beng Chin; Low, Bryan Kian Hsiang

NASI: Label- and Data-agnostic Neural Architecture Search at Initialization Technical Report

2021.

Links | BibTeX

1212.

Umamageswari, A.; Bharathiraja, N.; Irene, D. Shiny

A Novel Fuzzy C-Means based Chameleon Swarm Algorithm for Segmentation and Progressive Neural Architecture Search for Plant Disease Classification Journal Article

In: ICT Express, 2021, ISSN: 2405-9595.

Abstract | Links | BibTeX

1211.

Liu, Jinyuan; Wu, Yuhui; Huang, Zhanbo; Liu, Risheng; Fan, Xin

SMoA: Searching a Modality-Oriented Architecture for Infrared and Visible Image Fusion Journal Article

In: IEEE Signal Processing Letters, vol. 28, pp. 1818-1822, 2021.

Links | BibTeX

1210.

Liao, Yi-Lun; Karaman, Sertac; Sze, Vivienne

Searching for Efficient Multi-Stage Vision Transformers Technical Report

2021.

Links | BibTeX

1209.

Jlassi, Sinda; Jdey, Imen; Ltifi, Hela

Bayesian Hyperparameter Optimization of Deep Neural Network Algorithms Based on Ant Colony Optimization Proceedings Article

In: Lladós, Josep; Lopresti, Daniel; Uchida, Seiichi (Ed.): Document Analysis and Recognition -- ICDAR 2021, pp. 585–594, Springer International Publishing, Cham, 2021, ISBN: 978-3-030-86334-0.

Abstract | BibTeX

1208.

Cai, Shaofei; Li, Liang; Han, Xinzhe; Zha, Zhengjun; Huang, Qingming

Edge-featured Graph Neural Architecture Search Technical Report

2021.

Links | BibTeX

3157 entries « 39 of 64 »