AutoML.org

Freiburg-Hannover

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


1788 entries « 2 of 36 »

2022

1738.

Wang, Yabin; Ma, Zhiheng; Wei, Xing; Zheng, Shuai; Wang, Yaowei; Hong, Xiaopeng

ECCNAS: Efficient Crowd Counting Neural Architecture Search Journal Article

In: ACM Trans. Multimedia Comput. Commun. Appl., vol. 18, no. 1s, 2022, ISSN: 1551-6857.

Abstract | Links | BibTeX

1737.

Kim, Youngeun; Li, Yuhang; Park, Hyoungseob; Venkatesha, Yeshwanth; Panda, Priyadarshini

Neural Architecture Search for Spiking Neural Networks Technical Report

2022.

Links | BibTeX

1736.

Rho, Daniel; Park, Jinhyeok; Ko, Jong Hwan

NAS-VAD: Neural Architecture Search for Voice Activity Detection Technical Report

2022.

Links | BibTeX

1735.

Shu, Yao; Dai, Zhongxiang; Wu, Zhaoxuan; Low, Bryan Kian Hsiang

Unifying and Boosting Gradient-Based Training-Free Neural Architecture Search Technical Report

2022.

Links | BibTeX

1734.

Chen, Mingzhe; Xiao, Xi; Zhang, Bin; Liu, Xinyu; Lu, Runiu

Neural Architecture Searching for Facial Attributes-based Depression Recognition Technical Report

2022.

Links | BibTeX

1733.

Mao, Pengli; Lin, Yan; Xue, Song; Zhang, Baochang

Remaining Useful Life Estimation of Aircraft Engines Using Differentiable Architecture Search Journal Article

In: Mathematics, vol. 10, no. 3, 2022, ISSN: 2227-7390.

Links | BibTeX

1732.

Zhang, Xiaofan; Zhou, Zongwei; Chen, Deming; Wang, Yu Emma

AutoDistill: an End-to-End Framework to Explore and Distill Hardware-Efficient Language Models Technical Report

2022.

Links | BibTeX

1731.

Litany, Or; Maron, Haggai; Acuna, David; Kautz, Jan; Chechik, Gal; Fidler, Sanja

Federated Learning with Heterogeneous Architectures using Graph HyperNetworks Technical Report

2022.

Links | BibTeX

1730.

Hong, Zhenhou; Wang, Jianzong; Qu, Xiaoyang; Zhao, Chendong; Liu, Jie; Xiao, Jing

Neural Architecture Search as Self-assessor in Semi-supervised Learning Inproceedings

In: Liao, Xiangke; Zhao, Wei; Chen, Enhong; Xiao, Nong; Wang, Li; Gao, Yang; Shi, Yinghuan; Wang, Changdong; Huang, Dan (Ed.): Big Data, pp. 95–107, Springer Singapore, Singapore, 2022, ISBN: 978-981-16-9709-8.

Abstract | Links | BibTeX

1729.

Gao, Feng; Song, Bin; Wang, Dan; Qin, Hao

MR-DARTS: Restricted connectivity differentiable architecture search in multi-path search space Journal Article

In: Neurocomputing, vol. 482, pp. 27-39, 2022, ISSN: 0925-2312.

Abstract | Links | BibTeX

1728.

Ahn, Saehyun; Chang, Jung-Woo; Yoon, Hyeon-Seok; Kang, Suk-Ju

TouchNAS: Efficient Touch Detection Model Design Methodology for Resource-Constrained Devices Journal Article

In: IEEE Sensors Journal, pp. 1-1, 2022.

Links | BibTeX

1727.

Hassantabar, Shayan; Dai, Xiaoliang; Jha, Niraj K.

CURIOUS: Efficient Neural Architecture Search Based on a Performance Predictor and Evolutionary Search Journal Article

In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2022.

Links | BibTeX

1726.

Li, Wei; Wen, Shiping; Shi, Kaibo; Yang, Yin; Huang, Tingwen

Neural Architecture Search with a Lightweight Transformer for Text-to-Image Synthesis Journal Article

In: IEEE Transactions on Network Science and Engineering, pp. 1-1, 2022.

Links | BibTeX

1725.

Pauletto, Loïc; Amini, Massih-Reza; Winckler, Nicolas

Self Semi Supervised Neural Architecture Search for Semantic Segmentation Technical Report

2022.

Links | BibTeX

1724.

Xu, Dongkuan; Mukherjee, Subhabrata; Liu, Xiaodong; Dey, Debadeepta; Wang, Wenhui; Zhang, Xiang; Awadallah, Ahmed Hassan; Gao, Jianfeng

AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models Technical Report

2022.

Links | BibTeX

1723.

Wei, Hui; Lee, Feifei; Hu, Chunyan; Chen, Qiu

MOO-DNAS: Efficient Neural Network Design via Differentiable Architecture Search Based on Multi-Objective Optimization Journal Article

In: IEEE Access, vol. 10, pp. 14195-14207, 2022.

Links | BibTeX

1722.

Guo, Bicheng; He, Shibo; Chen, Tao; Chen, Jiming; Ye, Peng

Neural Architecture Ranker Technical Report

2022.

Links | BibTeX

1721.

Na, Byunggook; Mok, Jisoo; Park, Seongsik; Lee, Dongjin; Choe, Hyeokjun; Yoon, Sungroh

AutoSNN: Towards Energy-Efficient Spiking Neural Networks Technical Report

2022.

Links | BibTeX

1720.

Rguibi, Zakaria; Hajami, Abdelmajid; Dya, Zitouni

Äutomatic Searching of Deep Neural Networks for Medical Imaging Diagnostic Inproceedings

In: Saidi, Rajaa; Bhiri, Brahim El; Maleh, Yassine; Mosallam, Ayman; Essaaidi, Mohammed (Ed.): Ädvanced Technologies for Humanity", pp. 129–140, Springer International Publishing, Cham, 2022, ISBN: 978-3-030-94188-8.

Abstract | BibTeX

1719.

Cardoso, Rui P.; Hart, Emma; Kurka, David Burth; Pitt, Jeremy V.

Augmenting Novelty Search with a Surrogate Model to Engineer Meta-Diversity in Ensembles of Classifiers Technical Report

2022.

Links | BibTeX

1718.

Mehta, Yash; White, Colin; Zela, Arber; Krishnakumar, Arjun; Zabergja, Guri; Moradian, Shakiba; Safari, Mahmoud; Yu, Kaicheng; Hutter, Frank

NAS-Bench-Suite: NAS Evaluation is (Now) Surprisingly Easy Inproceedings

In: ICLR 2022, 2022.

Links | BibTeX

1717.

Kang, Ziyang; Wang, Shiying; Wang, Lei; Li, Shiming; Qu, Lianhua; Xu, Weixia

Hardware-aware liquid state machine generation for 2D/3D Network-on-Chip platforms Journal Article

In: Journal of Systems Architecture, vol. 124, pp. 102429, 2022, ISSN: 1383-7621.

Abstract | Links | BibTeX

1716.

Hu, Xing; Liang, Ling; Chen, Xiaobing; Deng, Lei; Ji, Yu; Ding, Yufei; Du, Zidong; Guo, Qi; Sherwood, Tim; Xie, Yuan

A Systematic View of Model Leakage Risks in Deep Neural Network Systems Journal Article

In: IEEE Transactions on Computers, pp. 1-1, 2022.

Links | BibTeX

1715.

Dushatskiy, Arkadiy; Alderliesten, Tanja; Bosman, Peter A. N.

Heed the Noise in Performance Evaluations in Neural Architecture Search Technical Report

2022.

Links | BibTeX

1714.

Cho, Hyunghun; Shin, Jungwook; Rhee, Wonjong

B2EA: An Evolutionary Algorithm Assisted by Two Bayesian Optimization Modules for Neural Architecture Search Technical Report

2022.

Links | BibTeX

1713.

Cho, Minsu; Joshi, Ameya; Garg, Siddharth; Reagen, Brandon; Hegde, Chinmay

Selective Network Linearization for Efficient Private Inference Technical Report

2022.

Links | BibTeX

1712.

Mazumder, Arnab Neelim; Mohsenin, Tinoosh

A Fast Network Exploration Strategy to Profile Low Energy Consumption for Keyword Spotting Technical Report

2022.

Links | BibTeX

1711.

Hassanzadeh, Tahereh; Essam, Daryl; Sarker, Ruhul

EvoDCNN: An Evolutionary Deep Convolutional Neural Network for Image Classification Journal Article

In: Neurocomputing, 2022, ISSN: 0925-2312.

Abstract | Links | BibTeX

1710.

Rabczuk, Timon; Guo, Hongwei; Zhuang, Xiaoying; Chen, Pengwan; Alajlan, Naif

Stochastic deep collocation method based on neural architecture search and transfer learning for heterogeneous porous media Journal Article

In: Engineering with Computers, vol. 2022, pp. 1 – 26, 2022.

Links | BibTeX

1709.

Lee, Jemin; Yu, Misun; Kwon, Yongin; Kim, Taeho

Quantune: Post-training Quantization of Convolutional Neural Networks using Extreme Gradient Boosting for Fast Deployment Technical Report

2022.

Links | BibTeX

1708.

Wang, Duo; Zhao, Yiren; Shumailov, Ilia; Mullins, Robert D.

Model Architecture Adaption for Bayesian Neural Networks Technical Report

2022.

Links | BibTeX

1707.

Elsken, Thomas; Zela, Arber; Metzen, Jan Hendrik; Staffler, Benedikt; Brox, Thomas; Valada, Abhinav; Hutter, Frank

Neural Architecture Search for Dense Prediction Tasks in Computer Vision Technical Report

2022.

Links | BibTeX

1706.

Sun, Junding; Yao, Chong; Liu, Jie; Liu, Weifan; Yu, Zekuan

GNAS-U2Net: A new optic cup and optic disc segmentation architecture with genetic neural architecture search Journal Article

In: IEEE Signal Processing Letters, pp. 1-1, 2022.

Links | BibTeX

1705.

Speckhard, Daniel T.; Misiunas, Karolis; Perel, Sagi; Zhu, Tenghui; Carlile, Simon; Slaney, Malcolm

Neural Architecture Search for Energy Efficient Always-on Audio Models Technical Report

2022.

Links | BibTeX

1704.

Jia, Liang; Tian, Ye; Zhang, Junguo

Domain-Aware Neural Architecture Search for Classifying Animals in Camera Trap Images Journal Article

In: Animals, vol. 12, no. 4, 2022, ISSN: 2076-2615.

Abstract | Links | BibTeX

1703.

Yang, Junhuan; Sheng, Yi; Zhang, Sizhe; Wang, Ruixuan; Foreman, Kenneth; Paige, Mikell; Jiao, Xun; Jiang, Weiwen; Yang, Lei

Automated Architecture Search for Brain-inspired Hyperdimensional Computing Technical Report

2022.

Links | BibTeX

1702.

Huang, Mingqiang; Liu, Yucen; Cheng, Quan; Yang, Shuxin; Li, Kai; Luo, Junyi; Yang, Zhengke; Li, Qiufeng; Yu, Hao; Man, Changhai

A High Throughput Multi-Bit-Width 3D Systolic Accelerator for NAS Optimized Deep Neural Networks on FPGA Inproceedings

In: Proceedings of the 2022 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, pp. 50, Association for Computing Machinery, Virtual Event, USA, 2022, ISBN: 9781450391498.

Abstract | Links | BibTeX

1701.

Teso-Fz-Betoño, Daniel; Zulueta, Ekaitz; Sanchez-Chica, Ander; Fernandez-Gamiz, Unai; Teso-Fz-Betoño, Adrian; Lopez-Guede, Jose Manuel

Neural architecture search for the estimation of relative positioning of the autonomous mobile robot Journal Article

In: Logic Journal of the IGPL, 2022, ISSN: 1367-0751, (jzac030).

Abstract | Links | BibTeX

1700.

Chen, Jiamin; Gao, Jianliang; Chen, Yibo; Oloulade, Babatounde MOCTARD; Lyu, Tengfei; Li, Zhao

Auto-GNAS: A Parallel Graph Neural Architecture Search Framework Journal Article

In: IEEE Transactions on Parallel and Distributed Systems, pp. 1-1, 2022.

Links | BibTeX

1699.

Kim, Youngkee; Yun, Won Joon; Lee, Youn Kyu; Kim, Joongheon

Two-Stage Architectural Fine-Tuning with Neural Architecture Search using Early-Stopping in Image Classification Technical Report

2022.

Links | BibTeX

1698.

Kim, Jae Kwan; Ahn, Wonbin; Park, Sangin; Lee, Soo-Hong; Kim, Laehyun

Early Prediction of Sepsis Onset Using Neural Architecture Search Based on Genetic Algorithms Journal Article

In: International Journal of Environmental Research and Public Health, vol. 19, no. 4, 2022, ISSN: 1660-4601.

Abstract | Links | BibTeX

1697.

Dai, Liuyao; Cheng, Quan; Wang, Yuhang; Huang, Gengbin; Zhou, Junzhuo; Li, Kai; Mao, Wei; Yu, Hao

An Energy-Efficient Bit-Split-and-Combination Systolic Accelerator for NAS-Based Multi-Precision Convolution Neural Networks Inproceedings

In: 2022 27th Asia and South Pacific Design Automation Conference (ASP-DAC), pp. 448-453, 2022.

Links | BibTeX

1696.

Lee, Jooyeon; Park, Junsang; Lee, Seunghyun; Kung, Jaeha

Implication of Optimizing NPU Dataflows on Neural Architecture Search for Mobile Devices Journal Article

In: ACM Trans. Des. Autom. Electron. Syst., 2022, ISSN: 1084-4309, (Just Accepted).

Abstract | Links | BibTeX

1695.

Zhang, Chunhui; Yuan, Xiaoming; Zhang, Qianyun; Zhu, Guangxu; Cheng, Lei; Zhang, Ning

Towards Tailored Models on Private AIoT Devices: Federated Direct Neural Architecture Search Technical Report

2022.

Links | BibTeX

1694.

Bosma, Martijn M. A.; Dushatskiy, Arkadiy; Grewal, Monika; Alderliesten, Tanja; Bosman, Peter A. N.

Mixed-Block Neural Architecture Search for Medical Image Segmentation Technical Report

2022.

Links | BibTeX

1693.

Sheng, Yi; Yang, Junhuan; Wu, Yawen; Mao, Kevin; Shi, Yiyu; Hu, Jingtong; Jiang, Weiwen; Yang, Lei

The Larger The Fairer? Small Neural Networks Can Achieve Fairness for Edge Devices Technical Report

2022.

Links | BibTeX

1692.

Zhao, Shixiong; Li, Fanxin; Chen, Xusheng; Shen, Tianxiang; Chen, Li; Wang, Sen; Zhang, Nicholas; Li, Cheng; Cui, Heming

NASPipe: High Performance and Reproducible Pipeline Parallel Supernet Training via Causal Synchronous Parallelism Inproceedings

In: Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 374–387, Association for Computing Machinery, Lausanne, Switzerland, 2022, ISBN: 9781450392051.

Abstract | Links | BibTeX

1691.

Zhang, Wentao; Shen, Yu; Lin, Zheyu; Li, Yang; Li, Xiaosen; Ouyang, Wen; Tao, Yangyu; Yang, Zhi; Cui, Bin

PaSca: a Graph Neural Architecture Search System under the Scalable Paradigm Technical Report

2022.

Links | BibTeX

1690.

Zhang, Tianning; Ang, Yee Sin; Li, Erping; Kee, Chun Yun; Ang, L. K.

SUTD-PRCM Dataset and Neural Architecture Search Approach for Complex Metasurface Design Technical Report

2022.

Links | BibTeX

1689.

Huang, Yongdong; Li, Yuanzhan; Cao, Xulong; Zhang, Siyu; Cai, Shen; Lu, Ting; Liu, Yuqi

An Efficient End-to-End 3D Model Reconstruction based on Neural Architecture Search Technical Report

2022.

Links | BibTeX

1788 entries « 2 of 36 »