AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3157 entries « 20 of 64 »

2022

2207.

Rorabaugh, Ariel Keller; Caíno-Lores, Silvina; Johnston, Travis; Taufer, Michela

High frequency accuracy and loss data of random neural networks trained on image datasets Journal Article

In: Data in Brief, vol. 40, pp. 107780, 2022, ISSN: 2352-3409.

Abstract | Links | BibTeX

2206.

Wang, Xin; Zhang, Ziwei; Zhu, Wenwu

Automated Graph Machine Learning: Approaches, Libraries and Directions Technical Report

2022.

Links | BibTeX

2205.

Rorabaugh, Ariel Keller; Caino-Lores, Silvina; Johnston, Travis; Taufer, Michela

Building High-throughput Neural Architecture Search Workflows via a Decoupled Fitness Prediction Engine Journal Article

In: IEEE Transactions on Parallel and Distributed Systems, pp. 1-1, 2022.

Links | BibTeX

2204.

Zhan, Cheng; Zhang, Licheng; Zhao, Xin; Lee, Chang-Chun; Huang, Shujiao

Neural Architecture Search for Inversion Technical Report

2022.

Links | BibTeX

2203.

Zhou, Jian; Zheng, Lianyu; Wang, Yiwei; Wang, Cheng; Gao, Robert X.

Automated model generation for machinery fault diagnosis based on reinforcement learning and neural architecture search Journal Article

In: IEEE Transactions on Instrumentation and Measurement, pp. 1-1, 2022.

Links | BibTeX

2202.

Zhang, Haoyu; Jin, Yaochu; Jin, Yaochu; Hao, Kuangrong

Evolutionary Search for Complete Neural Network Architectures with Partial Weight Sharing Journal Article

In: IEEE Transactions on Evolutionary Computation, pp. 1-1, 2022.

Links | BibTeX

2201.

Yipeng, Lv; Wenbing, Lv; Kaixuan, Han; Wentao, Tao; Ling, Zheng; Shizhuang, Weng; Lingsheng, Huang

Determination of wheat kernels damaged by Fusarium head blight using monochromatic images of effective wavelengths from hyperspectral imaging coupled with an architecture self-search deep network Journal Article

In: Food Control, pp. 108819, 2022, ISSN: 0956-7135.

Abstract | Links | BibTeX

2200.

Wu, Meng-Ting; Lin, Hung-I; Tsai, Chun-Wei

A Training-Free Genetic Neural Architecture Search Proceedings Article

In: Proceedings of the 2021 ACM International Conference on Intelligent Computing and Its Emerging Applications, pp. 65–70, Association for Computing Machinery, Jinan, China, 2022, ISBN: 9781450391603.

Abstract | Links | BibTeX

2199.

Chen, Yi-Ping; Tsai, Chun-Wei

An Effective Neural Architecture Optimization Algorithm for CNN Based on Search Economics Proceedings Article

In: Proceedings of the 2021 ACM International Conference on Intelligent Computing and Its Emerging Applications, pp. 40–45, Association for Computing Machinery, Jinan, China, 2022, ISBN: 9781450391603.

Abstract | Links | BibTeX

2198.

Pochelu, Pierrick; Petiton, Serge G.; Conche, Bruno

A Deep Neural Networks Ensemble Workflow from Hyperparameter Search to Inference Leveraging GPU Clusters Proceedings Article

In: International Conference on High Performance Computing in Asia-Pacific Region, pp. 61–71, Association for Computing Machinery, Virtual Event, Japan, 2022, ISBN: 9781450384988.

Abstract | Links | BibTeX

2197.

Durbha, Krishna Srikar; Amuru, Saidhiraj

AutoML Models for Wireless Signals Classification and their effectiveness against Adversarial Attacks Proceedings Article

In: 2022 14th International Conference on COMmunication Systems NETworkS (COMSNETS), pp. 265-269, 2022.

Links | BibTeX

2196.

Jiang, Chunheng; Pedapati, Tejaswini; Chen, Pin-Yu; Sun, Yizhou; Gao, Jianxi

Neural Capacitance: A New Perspective of Neural Network Selection via Edge Dynamics Technical Report

2022.

Links | BibTeX

2195.

Cai, Han; Lin, Ji; Han, Song

Chapter 4 - Efficient methods for deep learning Book Section

In: Davies, E. R.; Turk, Matthew A. (Ed.): Advanced Methods and Deep Learning in Computer Vision, pp. 159-190, Academic Press, 2022, ISBN: 978-0-12-822109-9.

Abstract | Links | BibTeX

2194.

Tan, Huixin; Lai, Jiewei; Liu, Yunbi; Song, Yuzhang; Wang, Jinliang; Chen, Mingyang; Yan, Yong; Zhong, Liming; Feng, Qianjin; Yang, Wei

Neural architecture search for real-time quality assessment of wearable multi-lead ECG on mobile devices Journal Article

In: Biomedical Signal Processing and Control, vol. 74, pp. 103495, 2022, ISSN: 1746-8094.

Abstract | Links | BibTeX

2193.

Traoré, Kalifou René; Camero, Andrés; Zhu, Xiao Xiang

Landscape of Neural Architecture Search across sensors: how much do they differ ? Technical Report

2022.

Links | BibTeX

2192.

Fedorov, Igor; Navarro, Ramon Matas; Tann, Hokchhay; Zhou, Chuteng; Mattina, Matthew; Whatmough, Paul N.

UDC: Unified DNAS for Compressible TinyML Models Technical Report

2022.

Links | BibTeX

2191.

Liu, Xin; Zhao, Jianwei; Li, Jie; Cao, Bin; Lv, Zhihan

Federated Neural Architecture Search for Medical Data Security Journal Article

In: IEEE Transactions on Industrial Informatics, pp. 1-1, 2022.

Links | BibTeX

2190.

Guo, Qingbei; Wu, Xiao-Jun; Kittler, Josef; Feng, Zhiquan

Differentiable neural architecture learning for efficient neural networks Journal Article

In: Pattern Recognition, vol. 126, pp. 108448, 2022, ISSN: 0031-3203.

Abstract | Links | BibTeX

2189.

Lin, Qiuzhen; Fang, Zhixiong; Chen, Yi; Tan, Kay Chen; Li, Yun

Evolutionary Architectural Search for Generative Adversarial Networks Journal Article

In: IEEE Transactions on Emerging Topics in Computational Intelligence, pp. 1-12, 2022.

Links | BibTeX

2188.

Wang, Yabin; Ma, Zhiheng; Wei, Xing; Zheng, Shuai; Wang, Yaowei; Hong, Xiaopeng

ECCNAS: Efficient Crowd Counting Neural Architecture Search Journal Article

In: ACM Trans. Multimedia Comput. Commun. Appl., vol. 18, no. 1s, 2022, ISSN: 1551-6857.

Abstract | Links | BibTeX

2187.

Kim, Youngeun; Li, Yuhang; Park, Hyoungseob; Venkatesha, Yeshwanth; Panda, Priyadarshini

Neural Architecture Search for Spiking Neural Networks Technical Report

2022.

Links | BibTeX

2186.

Rho, Daniel; Park, Jinhyeok; Ko, Jong Hwan

NAS-VAD: Neural Architecture Search for Voice Activity Detection Technical Report

2022.

Links | BibTeX

2185.

Shu, Yao; Dai, Zhongxiang; Wu, Zhaoxuan; Low, Bryan Kian Hsiang

Unifying and Boosting Gradient-Based Training-Free Neural Architecture Search Technical Report

2022.

Links | BibTeX

2184.

Chen, Mingzhe; Xiao, Xi; Zhang, Bin; Liu, Xinyu; Lu, Runiu

Neural Architecture Searching for Facial Attributes-based Depression Recognition Technical Report

2022.

Links | BibTeX

2183.

Mao, Pengli; Lin, Yan; Xue, Song; Zhang, Baochang

Remaining Useful Life Estimation of Aircraft Engines Using Differentiable Architecture Search Journal Article

In: Mathematics, vol. 10, no. 3, 2022, ISSN: 2227-7390.

Links | BibTeX

2182.

Zhang, Xiaofan; Zhou, Zongwei; Chen, Deming; Wang, Yu Emma

AutoDistill: an End-to-End Framework to Explore and Distill Hardware-Efficient Language Models Technical Report

2022.

Links | BibTeX

2181.

Litany, Or; Maron, Haggai; Acuna, David; Kautz, Jan; Chechik, Gal; Fidler, Sanja

Federated Learning with Heterogeneous Architectures using Graph HyperNetworks Technical Report

2022.

Links | BibTeX

2180.

Hong, Zhenhou; Wang, Jianzong; Qu, Xiaoyang; Zhao, Chendong; Liu, Jie; Xiao, Jing

Neural Architecture Search as Self-assessor in Semi-supervised Learning Proceedings Article

In: Liao, Xiangke; Zhao, Wei; Chen, Enhong; Xiao, Nong; Wang, Li; Gao, Yang; Shi, Yinghuan; Wang, Changdong; Huang, Dan (Ed.): Big Data, pp. 95–107, Springer Singapore, Singapore, 2022, ISBN: 978-981-16-9709-8.

Abstract | Links | BibTeX

2179.

Gao, Feng; Song, Bin; Wang, Dan; Qin, Hao

MR-DARTS: Restricted connectivity differentiable architecture search in multi-path search space Journal Article

In: Neurocomputing, vol. 482, pp. 27-39, 2022, ISSN: 0925-2312.

Abstract | Links | BibTeX

2178.

Ahn, Saehyun; Chang, Jung-Woo; Yoon, Hyeon-Seok; Kang, Suk-Ju

TouchNAS: Efficient Touch Detection Model Design Methodology for Resource-Constrained Devices Journal Article

In: IEEE Sensors Journal, pp. 1-1, 2022.

Links | BibTeX

2177.

Hassantabar, Shayan; Dai, Xiaoliang; Jha, Niraj K.

CURIOUS: Efficient Neural Architecture Search Based on a Performance Predictor and Evolutionary Search Journal Article

In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2022.

Links | BibTeX

2176.

Li, Wei; Wen, Shiping; Shi, Kaibo; Yang, Yin; Huang, Tingwen

Neural Architecture Search with a Lightweight Transformer for Text-to-Image Synthesis Journal Article

In: IEEE Transactions on Network Science and Engineering, pp. 1-1, 2022.

Links | BibTeX

2175.

Pauletto, Loïc; Amini, Massih-Reza; Winckler, Nicolas

Self Semi Supervised Neural Architecture Search for Semantic Segmentation Technical Report

2022.

Links | BibTeX

2174.

Xu, Dongkuan; Mukherjee, Subhabrata; Liu, Xiaodong; Dey, Debadeepta; Wang, Wenhui; Zhang, Xiang; Awadallah, Ahmed Hassan; Gao, Jianfeng

AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models Technical Report

2022.

Links | BibTeX

2173.

Wei, Hui; Lee, Feifei; Hu, Chunyan; Chen, Qiu

MOO-DNAS: Efficient Neural Network Design via Differentiable Architecture Search Based on Multi-Objective Optimization Journal Article

In: IEEE Access, vol. 10, pp. 14195-14207, 2022.

Links | BibTeX

2172.

Guo, Bicheng; He, Shibo; Chen, Tao; Chen, Jiming; Ye, Peng

Neural Architecture Ranker Technical Report

2022.

Links | BibTeX

2171.

Na, Byunggook; Mok, Jisoo; Park, Seongsik; Lee, Dongjin; Choe, Hyeokjun; Yoon, Sungroh

AutoSNN: Towards Energy-Efficient Spiking Neural Networks Technical Report

2022.

Links | BibTeX

2170.

Rguibi, Zakaria; Hajami, Abdelmajid; Dya, Zitouni

Äutomatic Searching of Deep Neural Networks for Medical Imaging Diagnostic Proceedings Article

In: Saidi, Rajaa; Bhiri, Brahim El; Maleh, Yassine; Mosallam, Ayman; Essaaidi, Mohammed (Ed.): Ädvanced Technologies for Humanity", pp. 129–140, Springer International Publishing, Cham, 2022, ISBN: 978-3-030-94188-8.

Abstract | BibTeX

2169.

Cardoso, Rui P.; Hart, Emma; Kurka, David Burth; Pitt, Jeremy V.

Augmenting Novelty Search with a Surrogate Model to Engineer Meta-Diversity in Ensembles of Classifiers Technical Report

2022.

Links | BibTeX

2168.

Mehta, Yash; White, Colin; Zela, Arber; Krishnakumar, Arjun; Zabergja, Guri; Moradian, Shakiba; Safari, Mahmoud; Yu, Kaicheng; Hutter, Frank

NAS-Bench-Suite: NAS Evaluation is (Now) Surprisingly Easy Proceedings Article

In: ICLR 2022, 2022.

Links | BibTeX

2167.

Kang, Ziyang; Wang, Shiying; Wang, Lei; Li, Shiming; Qu, Lianhua; Xu, Weixia

Hardware-aware liquid state machine generation for 2D/3D Network-on-Chip platforms Journal Article

In: Journal of Systems Architecture, vol. 124, pp. 102429, 2022, ISSN: 1383-7621.

Abstract | Links | BibTeX

2166.

Hu, Xing; Liang, Ling; Chen, Xiaobing; Deng, Lei; Ji, Yu; Ding, Yufei; Du, Zidong; Guo, Qi; Sherwood, Tim; Xie, Yuan

A Systematic View of Model Leakage Risks in Deep Neural Network Systems Journal Article

In: IEEE Transactions on Computers, pp. 1-1, 2022.

Links | BibTeX

2165.

Dushatskiy, Arkadiy; Alderliesten, Tanja; Bosman, Peter A. N.

Heed the Noise in Performance Evaluations in Neural Architecture Search Technical Report

2022.

Links | BibTeX

2164.

Cho, Hyunghun; Shin, Jungwook; Rhee, Wonjong

B2EA: An Evolutionary Algorithm Assisted by Two Bayesian Optimization Modules for Neural Architecture Search Technical Report

2022.

Links | BibTeX

2163.

Cho, Minsu; Joshi, Ameya; Garg, Siddharth; Reagen, Brandon; Hegde, Chinmay

Selective Network Linearization for Efficient Private Inference Technical Report

2022.

Links | BibTeX

2162.

Mazumder, Arnab Neelim; Mohsenin, Tinoosh

A Fast Network Exploration Strategy to Profile Low Energy Consumption for Keyword Spotting Technical Report

2022.

Links | BibTeX

2161.

Hassanzadeh, Tahereh; Essam, Daryl; Sarker, Ruhul

EvoDCNN: An Evolutionary Deep Convolutional Neural Network for Image Classification Journal Article

In: Neurocomputing, 2022, ISSN: 0925-2312.

Abstract | Links | BibTeX

2160.

Rabczuk, Timon; Guo, Hongwei; Zhuang, Xiaoying; Chen, Pengwan; Alajlan, Naif

Stochastic deep collocation method based on neural architecture search and transfer learning for heterogeneous porous media Journal Article

In: Engineering with Computers, vol. 2022, pp. 1 – 26, 2022.

Links | BibTeX

2159.

Lee, Jemin; Yu, Misun; Kwon, Yongin; Kim, Taeho

Quantune: Post-training Quantization of Convolutional Neural Networks using Extreme Gradient Boosting for Fast Deployment Technical Report

2022.

Links | BibTeX

2158.

Wang, Duo; Zhao, Yiren; Shumailov, Ilia; Mullins, Robert D.

Model Architecture Adaption for Bayesian Neural Networks Technical Report

2022.

Links | BibTeX

3157 entries « 20 of 64 »