AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4189 entries « 44 of 84 »

2022

2039.

Wang, Ting-Ting; Chu, Shu-Chuan; Hu, Chia-Cheng; Jia, Han-Dong; Pan, Jeng-Shyang

Efficient Network Architecture Search Using Hybrid Optimizer Journal Article

In: Entropy, vol. 24, no. 5, 2022, ISSN: 1099-4300.

Abstract | Links | BibTeX

2038.

Li, Boyang; Lu, Qing; Jiang, Weiwen; Jung, Taeho; Shi, Yiyu

A collaboration strategy in the mining pool for proof-of-neural-architecture consensus Journal Article

In: Blockchain: Research and Applications, pp. 100089, 2022, ISSN: 2096-7209.

Abstract | Links | BibTeX

2037.

Zheng, Chenyu; Wang, Junjue; Ma, Ailong; Zhong, Yanfei

AutoLC: Search Lightweight and Top-Performing Architecture for Remote Sensing Image Land-Cover Classification Technical Report

2022.

Links | BibTeX

2036.

Basha, S. H. Shabbeer; Tula, Debapriya; Vinakota, Sravan Kumar; Dubey, Shiv Ram

Target Aware Network Architecture Search and Compression for Efficient Knowledge Transfer Technical Report

2022.

Links | BibTeX

2035.

Ren, Yankun; Li, Longfei; Yang, Xinxing; Zhou, Jun

AutoTransformer: Automatic Transformer Architecture Design For Time Series Classification Proceedings Article

In: Advances in Knowledge Discovery and Data Mining: 26th Pacific-Asia Conference, PAKDD 2022, Chengdu, China, May 16–19, 2022, Proceedings, Part I, pp. 143–155, Springer-Verlag, Chengdu, China, 2022, ISBN: 978-3-031-05932-2.

Abstract | Links | BibTeX

2034.

Deng, Difan; Karl, Florian; Hutter, Frank; Bischl, Bernd; Lindauer, Marius

Efficient Automated Deep Learning for Time Series Forecasting Technical Report

2022.

Links | BibTeX

2033.

Du, Mengge; Chen, Yuntian; Zhang, Dongxiao

AutoKE: An automatic knowledge embedding framework for scientific machine learning Journal Article

In: CoRR, vol. abs/2205.05390, 2022.

Links | BibTeX

2032.

Kim, Do-Guk; Lee, Heung-Chang

Proxyless Neural Architecture Adaptation for Supervised Learning and Self-Supervised Learning Technical Report

2022.

Links | BibTeX

2031.

Sun, Jialiang; Zheng, Xiaohu; Yao, Wen; Zhang, Xiaoya; Zhou, Weien

Heat Source Layout Optimization Using Automatic Deep Learning Surrogate Model and Multimodal Neighborhood Search Algorithm Technical Report

2022.

Links | BibTeX

2030.

Belciug, Smaranda

Learning deep neural networks' architectures using differential evolution. Case study: Medical imaging processing Journal Article

In: Computers in Biology and Medicine, vol. 146, pp. 105623, 2022, ISSN: 0010-4825.

Abstract | Links | BibTeX

2029.

Frey, Nathan; Soklaski, Ryan; Axelrod, Simon; Samsi, Siddharth; Gomez-Bombarelli, Rafael; Coley, Connor; Gadepally, Vijay

Neural Scaling of Deep Chemical Models Journal Article

In: ChemRxiv, 2022.

Links | BibTeX

2028.

Miriyala, Srinivas Soumitri; Pujari, Keerthi NagaSree; Naik, Sakshi; Mitra, Kishalay

Evolutionary neural architecture search for surrogate models to enable optimization of industrial continuous crystallization process Journal Article

In: Powder Technology, vol. 405, pp. 117527, 2022, ISSN: 0032-5910.

Abstract | Links | BibTeX

2027.

Lee, Joo-Hyun; Chang, Joon-Hyuk; Yang, Jae-Mo; Moon, Han-Gil

NAS-TasNet: Neural Architecture Search for Time-Domain Speech Separation Journal Article

In: IEEE Access, vol. 10, pp. 56031-56043, 2022.

Links | BibTeX

2026.

Qian, Qi; Sang, Qingbing

No-reference image quality assessment based on automatic machine learning Journal Article

In: ITM Web Conf., vol. 45, pp. 01034, 2022.

Links | BibTeX

2025.

Ogundokun, Roseline Oluwaseun; Misra, Sanjay; Douglas, Mychal; Damaševičius, Robertas; Maskeliūnas, Rytis

Medical Internet-of-Things Based Breast Cancer Diagnosis Using Hyperparameter-Optimized Neural Networks Journal Article

In: Future Internet, vol. 14, no. 5, 2022, ISSN: 1999-5903.

Abstract | Links | BibTeX

2024.

Xu, Ship Peng; Wang, Ke; Hassan, Md. Rafiul; Hassan, Mohammad Mehedi; Chen, Chien-Ming

An Interpretive Perspective: Adversarial Trojaning Attack on Neural-Architecture-Search Enabled Edge AI Systems Journal Article

In: IEEE Transactions on Industrial Informatics, pp. 1-1, 2022.

Links | BibTeX

2023.

Cummings, Daniel; Sarah, Anthony; Sridhar, Sharath Nittur; Szankin, Maciej; Muñoz, Juan Pablo; Sundaresan, Sairam

A Hardware-Aware Framework for Accelerating Neural Architecture Search Across Modalities Technical Report

2022.

Links | BibTeX

2022.

Li, Yanyu; Zhao, Pu; Yuan, Geng; Lin, Xue; Wang, Yanzhi; Chen, Xin

Pruning-as-Search: Efficient Neural Architecture Search via Channel Pruning and Structural Reparameterization Technical Report

2022.

Links | BibTeX

2021.

Smith, James Seale; Seymour, Zachary; Chiu, Han-Pang

Incremental Learning with Differentiable Architecture and Forgetting Search Technical Report

2022.

Links | BibTeX

2020.

Tuli, Shikhar; Dedhia, Bhishma; Tuli, Shreshth; Jha, Niraj K.

FlexiBERT: Are Current Transformer Architectures too Homogeneous and Rigid? Technical Report

2022.

Links | BibTeX

2019.

Risso, Matteo; Burrello, Alessio; Conti, Francesco; Lamberti, Lorenzo; Chen, Yukai; Benini, Luca; Macii, Enrico; Poncino, Massimo; Pagliari, Daniele Jahier

Lightweight Neural Architecture Search for Temporal Convolutional Networks at the Edge Journal Article

In: IEEE Transactions on Computers, pp. 1-1, 2022.

Links | BibTeX

2018.

Gao, Yang; Zhang, Peng; Yang, Hong; Zhou, Chuan; Tian, Zhihong; Hu, Yue; Li, Zhao; Zhou, Jingren

GraphNAS++: Distributed Architecture Search for Graph Neural Networks Journal Article

In: IEEE Transactions on Knowledge and Data Engineering, pp. 1-1, 2022.

Links | BibTeX

2017.

Zhang, Zeyang; Chen, Yidong; Zhou, Changle

Self-Growing Binary Activation Network: A Novel Deep Learning Model With Dynamic Architecture Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-10, 2022.

Links | BibTeX

2016.

Abbasi, Saad; Wong, Alexander; Shafiee, Mohammad Javad

MAPLE-X: Latency Prediction with Explicit Microprocessor Prior Knowledge Technical Report

2022.

Links | BibTeX

2015.

Paulo, Maurício; Turnes, Javier Noa; Happ, P.; Ferreira, Matheus; Marques, Haroldo; Feitosa, Raul

HOW FAR SHOULD I LOOK? A NEURAL ARCHITECTURE SEARCH STRATEGY FOR SEMANTIC SEGMENTATION OF REMOTE SENSING IMAGES Journal Article

In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. V-3-2022, pp. 17-23, 2022.

Links | BibTeX

2014.

Lopes, Vasco; Santos, Miguel; Degardin, Bruno; Alexandre, Luís A.

Efficient Guided Evolution for Neural Architecture Search Proceedings Article

In: GECCO2022, 2022.

Links | BibTeX

2013.

Wang, Yicheng; Han, Xiaotian; Chang, Chia-Yuan; Zha, Daochen; Braga-Neto, Ulisses; Hu, Xia

Auto-PINN: Understanding and Optimizing Physics-Informed Neural Architecture Technical Report

2022.

Links | BibTeX

2012.

Li, Yanyu; Zhao, Pu; Yuan, Geng; Lin, Xue; Wang, Yanzhi; Chen, Xin

Pruning-as-Search: Efficient Neural Architecture Search via Channel Pruning and Structural Reparameterization Technical Report

2022.

Links | BibTeX

2011.

Risso, Matteo; Burrello, Alessio; Benini, Luca; Macii, Enrico; Poncino, Massimo; Pagliari, Daniele Jahier

Multi-Complexity-Loss DNAS for Energy-Efficient and Memory-Constrained Deep Neural Networks Technical Report

2022.

Links | BibTeX

2010.

Li, Yanyu; Yuan, Geng; Wen, Yang; Hu, Eric; Evangelidis, Georgios; Tulyakov, Sergey; Wang, Yanzhi; Ren, Jian

EfficientFormer: Vision Transformers at MobileNet Speed Technical Report

2022.

Links | BibTeX

2009.

Zheng, Xiawu; Fei, Xiang; Zhang, Lei; Wu, Chenglin; Chao, Fei; Liu, Jianzhuang; Zeng, Wei; Tian, Yonghong; Ji, Rongrong

Neural Architecture Search With Representation Mutual Information Proceedings Article

In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11912–11921, 2022.

Links | BibTeX

2008.

Pan, Junyi; Sun, Chong; Zhou, Yizhou; Zhang, Ying; Li, Chen

Distribution Consistent Neural Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10884–10893, 2022.

Links | BibTeX

2007.

Xie, Pengtao; Du, Xuefeng

Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11922–11932, 2022.

Links | BibTeX

2006.

Xu, Kepeng; He, Gang

DNAS: A Decoupled Global Neural Architecture Search Method Proceedings Article

In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1979–1985, 2022.

Links | BibTeX

2005.

Shang, Ronghua; Zhu, Songling; Ren, Jinhong; Liu, Hangcheng; Jiao, Licheng

Evolutionary neural architecture search based on evaluation correction and functional units Journal Article

In: Knowledge-Based Systems, vol. 251, pp. 109206, 2022, ISSN: 0950-7051.

Abstract | Links | BibTeX

2004.

Liu, Shiqing; Zhang, Haoyu; Jin, Yaochu

A Survey on Surrogate-assisted Efficient Neural Architecture Search Technical Report

2022.

Links | BibTeX

2003.

Kim, Youngkee; Jung, Soyi; Choi, Minseok; Kim, Joongheon

Search Space Adaptation for Differentiable Neural Architecture Search in Image Classification Technical Report

2022.

Links | BibTeX

2002.

Li, Wenshuo; Chen, Xinghao; Bai, Jinyu; Ning, Xuefei; Wang, Yunhe

Searching for Energy-Efficient Hybrid Adder-Convolution Neural Networks Proceedings Article

In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1943–1952, 2022.

Links | BibTeX

2001.

Ferjani, Imen; Hidri, Minyar Sassi; Frihida, Ali

SiNoptiC: swarm intelligence optimisation of convolutional neural network architectures for text classification Journal Article

In: International Journal of Computer Applications in Technology, vol. 68, no. 1, pp. 82-100, 2022.

Links | BibTeX

2000.

Liu, Jinyuan; Wu, Yuhui; Wu, Guanyao; Liu, Risheng; Fan, Xin

Learn to Search a Lightweight Architecture for Target-aware Infrared and Visible Image Fusion Journal Article

In: IEEE Signal Processing Letters, pp. 1-5, 2022.

Links | BibTeX

1999.

Li, Zhuowei; Gao, Yibo; Zha, Zhenzhou; Hu, Zhiqiang; Xia, Qing; Zhang, Shaoting; Metaxas, Dimitris N.

Towards Self-supervised and Weight-preserving Neural Architecture Search Technical Report

2022.

Links | BibTeX

1998.

Du, Yipeng; Liu, Jian; Wang, Xiang; Wang, Peng

SSVEP based Emotion Recognition for IoT via Multiobjective Neural Architecture Search Journal Article

In: IEEE Internet of Things Journal, pp. 1-1, 2022.

Links | BibTeX

1997.

Zhang, Yuanhan; Zhou, Kaiyang; Liu, Ziwei

Neural Prompt Search Technical Report

2022.

Links | BibTeX

1996.

Huang, Mingqiang; Liu, Yucen; Man, Changhai; Li, Kai; Cheng, Quan; Mao, Wei; Yu, Hao

A High Performance Multi-Bit-Width Booth Vector Systolic Accelerator for NAS Optimized Deep Learning Neural Networks Journal Article

In: IEEE Transactions on Circuits and Systems I: Regular Papers, pp. 1-13, 2022.

Links | BibTeX

1995.

Xue, Xizhe; Zhang, Haokui; Fang, Bei; Bai, Zongwen; Li, Ying

Grafting Transformer on Automatically Designed Convolutional Neural Network for Hyperspectral Image Classification Journal Article

In: IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-16, 2022.

Links | BibTeX

1994.

Aradhya, Abhay M. S.; Ashfahani, Andri; Angelina, Fienny; Pratama, Mahardhika; Mello, Rodrigo Fernandes; Sundaram, Suresh

Autonomous CNN (AutoCNN): A data-driven approach to network architecture determination Journal Article

In: Information Sciences, vol. 607, pp. 638-653, 2022, ISSN: 0020-0255.

Abstract | Links | BibTeX

1993.

Shahawy, Mohamed; Benkhelifa, Elhadj; White, David

A Review on Plastic Artificial Neural Networks: Exploring the Intersection between Neural Architecture Search and Continual Learning Technical Report

2022.

Links | BibTeX

1992.

Franken, G. G. H.; Singh, Prabhant; Vanschoren, Joaquin

EmProx: Neural Network Performance Estimation For Neural Architecture Search Technical Report

2022.

Links | BibTeX

1991.

Lu, Qing; Xu, Xiaowei; Dong, Shunjie; Hao, Cong; Yang, Lei; Zhuo, Cheng; Shi, Yiyu

RT-DNAS: Real-time Constrained Differentiable Neural Architecture Search for 3D Cardiac Cine MRI Segmentation Technical Report

2022.

Links | BibTeX

1990.

Liu, Jiawei; Zhang, Kaiyu; Hu, Weitai; Yang, Qing

Improve Ranking Correlation of Super-net through Training Scheme from One-shot NAS to Few-shot NAS Technical Report

2022.

Links | BibTeX

4189 entries « 44 of 84 »