AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.

3271 entries « ‹ 4 of 66 › »

2024

3121.

Lin, Wei; Peng, Xu; Yu, Zhengtao; Jin, Taisong

Hypergraph Neural Architecture Search Proceedings Article

In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 13837–13845, AAAI Press, 2024.

3120.

Liang, Xinyan; Fu, Pinhan; Guo, Qian; Zheng, Keyin; Qian, Yuhua

DC-NAS: Divide-and-Conquer Neural Architecture Search for Multi-Modal Classification Proceedings Article

In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 13754–13762, AAAI Press, 2024.

3119.

Cai, Zicheng; Chen, Lei; Liu, Peng; Ling, Tongtao; Lai, Yutao

EG-NAS: Neural Architecture Search with Fast Evolutionary Exploration Proceedings Article

In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 11159–11167, AAAI Press, 2024.

3118.

Cai, Jie; Wang, Xin; Li, Haoyang; Zhang, Ziwei; Zhu, Wenwu

Multimodal Graph Neural Architecture Search under Distribution Shifts Proceedings Article

In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 8227–8235, AAAI Press, 2024.

3117.

Peng, Chensheng; Zeng, Zhaoyu; Gao, Jinling; Zhou, Jundong; Tomizuka, Masayoshi; Wang, Xinbing; Zhou, Chenghu; Ye, Nanyang

PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Search Miscellaneous

2024.

3116.

Levchenko, Denis; Rappos, Efstratios; Ataee, Shabnam; Nigro, Biagio; Robert, Stephan

Chain-structured neural architecture search for financial time series forecasting Technical Report

2024.

3115.

Ali, Muhammad Junaid; Moalic, Laurent; Essaid, Mokhtar; Idoumghar, Lhassane

Robust Neural Architecture Search Using Differential Evolution for Medical Images Proceedings Article

In: Smith, Stephen; Correia, João; Cintrano, Christian (Ed.): Applications of Evolutionary Computation, pp. 163–179, Springer Nature Switzerland, Cham, 2024, ISBN: 978-3-031-56855-8.

Abstract | Links | BibTeX

3114.

He, Zhimin; Deng, Maijie; Zheng, Shenggen; Li, Lvzhou; Situ, Haozhen

Training-Free Quantum Architecture Search Proceedings Article

In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 12430–12438, AAAI Press, 2024.

3113.

Benmeziane, Hadjer

A Pre-Search Evaluation Framework for Assessing Search Space Complexity Proceedings Article

In: The Second Tiny Papers Track at ICLR 2024, 2024.

3112.

Garcia-Garcia, Cosijopii; Morales-Reyes, Alicia; Escalante, Hugo Jair

Progressive Self-supervised Multi-objective NAS for Image Classification Proceedings Article

In: Smith, Stephen; Correia, João; Cintrano, Christian (Ed.): Applications of Evolutionary Computation, pp. 180–195, Springer Nature Switzerland, Cham, 2024, ISBN: 978-3-031-56855-8.

Abstract | Links | BibTeX

3111.

Feng, Tai-Che; Wang, Sheng-De

VP-DARTS: Validated Pruning Differentiable Architecture Search Proceedings Article

In: Rocha, Ana Paula; Steels, Luc; Herik, H. Jaap (Ed.): Proceedings of the 16th International Conference on Agents and Artificial Intelligence, ICAART 2024, Volume 2, Rome, Italy, February 24-26, 2024, pp. 47–57, SCITEPRESS, 2024.

3110.

Zhu, Chendi; Li, Lujun; Wu, Yuli; Sun, Zhengxing

SasWOT: Real-Time Semantic Segmentation Architecture Search WithOut Training Proceedings Article

In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 7722–7730, AAAI Press, 2024.

3109.

Lu, Liming; Chen, Zhenghan; Lu, Xiaoyu; Rao, Yihang; Li, Lujun; Pang, Shuchao

UniADS: Universal Architecture-Distiller Search for Distillation Gap Proceedings Article

In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 14167–14174, AAAI Press, 2024.

3108.

Diaz, Edicson Santiago Bonilla; Naredo, Enrique; D'ıaz, Nicolas Francisco Mateo; Dias, Douglas Mota; Diaz, Maria Alejandra Bonilla; Harnett, Susan; Ryan, Conor

Neural Architecture Search for Bearing Fault Classification Proceedings Article

In: Rocha, Ana Paula; Steels, Luc; Herik, H. Jaap (Ed.): Proceedings of the 16th International Conference on Agents and Artificial Intelligence, ICAART 2024, Volume 2, Rome, Italy, February 24-26, 2024, pp. 288–300, SCITEPRESS, 2024.

3107.

Xia, Yizhang; Song, Shihao; Hou, Zhanglu; Xu, Junwen; Zou, Juan; Liu, Yuan; Yang, Shengxiang

An Evolutionary Network Architecture Search Framework with Adaptive Multimodal Fusion for Hand Gesture Recognition Technical Report

2024.

3106.

Tzolopoulos, Georgios; Korgialas, Christos; Kotropoulos, Constantine

On Spectrogram Analysis in a Multiple Classifier Fusion Framework for Power Grid Classification Using Electric Network Frequency Proceedings Article

In: Santana, Modesto Castrillón; Marsico, Maria De; Fred, Ana L. N. (Ed.): Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods, ICPRAM 2024, Rome, Italy, February 24-26, 2024, pp. 91–99, SCITEPRESS, 2024.

3105.

Cai, Zicheng; Chen, Lei; Ling, Tongtao; Liu, Hai-Lin

STO-DARTS: Stochastic Bilevel Optimization for Differentiable Neural Architecture Search Journal Article

In: IEEE Transactions on Emerging Topics in Computational Intelligence, pp. 1-12, 2024.

3104.

Han, Xian-Hua; Jiang, Huiyan; Chen, Yen-Wei

Hyperspectral Image Reconstruction Using Hierarchical Neural Architecture Search from A Snapshot Image Proceedings Article

In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2500-2504, 2024.

3103.

Rana, Amrita; Kim, Kyung Ki

NAS-OD: Neural Architecture Search for Object Detection Proceedings Article

In: 2024 International Conference on Electronics, Information, and Communication (ICEIC), pp. 1-3, 2024.

3102.

Ma, Lianbo; Li, Nan; Zhu, Peican; Tang, Keke; Khan, Asad; Wang, Feng; Yu, Guo

A Novel Fuzzy Neural Network Architecture Search Framework for Defect Recognition With Uncertainties Journal Article

In: IEEE Transactions on Fuzzy Systems, pp. 1-12, 2024.

3101.

Jin, Cong; Huang, Jin-jie

Inner Loop-Based Modified Differentiable Architecture Search Journal Article

In: IEEE Access, vol. 12, pp. 41918–41933, 2024.

3100.

Xu, Hongyan; Pei, Xiaohuan; Su, Xiu; You, Shan; Xu, Chang

TCNAS: Transformer Architecture Evolving in Code Clone Detection Proceedings Article

In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5745-5749, 2024.

3099.

Fu, Hongming; Wu, Guanyao; Liu, Zhu; Yan, Tiantian; Liu, Jinyuan

Segmentation-Driven Infrared and Visible Image Fusion Via Transformer-Enhanced Architecture Searching Proceedings Article

In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 4230-4234, 2024.

3098.

Liao, Yugang; Li, Junqing; Wei, Shuwei; Xiao, Xiumei

Evolutionary Search via channel attention based parameter inheritance and stochastic uniform sampled training Journal Article

In: Computer Vision and Image Understanding, vol. 243, pp. 104000, 2024, ISSN: 1077-3142.

Abstract | Links | BibTeX

@article{LIAO2024104000,

title = {Evolutionary Search via channel attention based parameter inheritance and stochastic uniform sampled training},

author = {Yugang Liao and Junqing Li and Shuwei Wei and Xiumei Xiao},

url = {https://www.sciencedirect.com/science/article/pii/S107731422400081X},

doi = {https://doi.org/10.1016/j.cviu.2024.104000},

issn = {1077-3142},

year  = {2024},

date = {2024-01-01},

urldate = {2024-01-01},

journal = {Computer Vision and Image Understanding},

volume = {243},

pages = {104000},

abstract = {Convolutional neural networks’ performance is significantly affected by their architecture. Different algorithms have been developed to aid in automating the network structure selection. Recently, evolutionary neural architecture search (ENAS) methods have gained increasing number of attentions due to their excellent global search capability. Nevertheless, evolutionary neural architecture can be computationally expensive since improving evolution typically involves many performance evaluations. This study introduces a framework utilizing evolutionary search for a lightweight channel attention convolutional network. It leverages stochastic uniform sampled and parameter inheritance to address these challenges. The lightweight channel attention method is applied to the model to make it more capable of extracting features while using fewer parameters. In this framework, parent individuals undergo stochastic sampling and receive training repeatedly on each mini-batch of the training dataset. The strategy of parameter inheritance enables the assessment of offspring individuals’ fitness without fully training the offspring candidate network. Compared to existing methods on standard-bench (CIFAR-10, CIFAR-100, ImageNet) and real-world datasets(NEU-CLS, Chest Xray2017), our model demonstrated superior search efficiency by several orders of magnitude. Our experiments showed that Stochastic uniform sampled evolutionary Network (SUSE-Net) achieved the lowest error rate among state-of-the-art NAS models, with 2.55% for CIFAR-10, 14.8% for CIFAR-100, and 23.2% for ImageNet dataset. This results indicate that the proposed algorithm is not only more computationally efficient, but also competitive with existing methods in terms of learning performance.},

keywords = {},

pubstate = {published},

tppubtype = {article}

}

3097.

Niu, Ruicheng; Zhu, Ziyuan; Li, Chaofei; Meng, Dan

Search Robust and Adaptable Architecture Proceedings Article

In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5155-5159, 2024.

3096.

Su, Xiu; You, Shan; Xu, Hongyan; Li, Xiuxing; Long, Jun; Chen, Yi; Xu, Chang

Beyond the Limit of Weight-Sharing: Pioneering Space-Evolving NAS with Large Language Models Proceedings Article

In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6225-6229, 2024.

3095.

Chen, Yule; Liang, Hong; Jiao, Shaohua

NAS-MFF:NAS-Guided Multiscale Feature Fusion Network with Pareto Optimization for Sonar Images Classification Journal Article

In: IEEE Sensors Journal, pp. 1-1, 2024.

3094.

Zhang, Zhaokai; Feng, Tianpeng; Liu, Yang; Sheng, Chunnan; Wang, Fanyi; Cai, He

DBS: Differentiable Budget-Aware Searching For Channel Pruning Proceedings Article

In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5810-5814, 2024.

3093.

Xia, Renqiu; Zhang, Dongyuan; Dong, Yixin; Zhao, Juanping; Liao, Wenlong; He, Tao; Yan, Junchi

Efficient Architecture Search for Real-Time Instance Segmentation Proceedings Article

In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3310-3314, 2024.

3092.

Lee, Junghyup; Ham, Bumsub

AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Search Technical Report

2024.

3091.

Zhou, Qiqi; Zhu, Yichen

When Training-Free Nas Meets Vision Transformers: A Neural Tangent Kernel Perspective Proceedings Article

In: 2024.

3090.

Lv, Zeqiong; Qian, Chao; Yen, Gary G.; Sun, Yanan

Analyzing the Expected Hitting Time of Evolutionary Computation-Based Neural Architecture Search Algorithms Journal Article

In: IEEE Transactions on Emerging Topics in Computational Intelligence, pp. 1-13, 2024.

3089.

Sakuma, Yuiko; Yoshimura, Masakazu; Otsuka, Junji; Irie, Atsushi; Ohashi, Takeshi

Mixed-precision Supernet Training from Vision Foundation Models using Low Rank Adapter Technical Report

2024.

2023

3088.

(Ed.)

Designing a New Search Space for Multivariate Time-Series Neural Architecture Search Collection

2023.

3087.

Zhao, Junbo; Ning, Xuefei; Liu, Enshu; Ru, Binxin; Zhou, Zixuan; Zhao, Tianchen; Chen, Chen; Zhang, Jiajin; Liao, Qingmin; Wang, Yu

Dynamic Ensemble of Low-fidelity Experts: Mitigating NAS “Cold-Start” Technical Report

2023.

3086.

Zhang, Baochang; Xu, Sheng; Lin, Mingbao; Wang, Tiancheng; Doermann, David

Binary Neural Networks: Algorithms, Architectures, and Applications Book

2023.

3085.

(Ed.)

Multi-task Graph Neural Architecture Search with Task-aware Collaboration and Curriculum Collection

2023.

3084.

(Ed.)

Unsupervised Graph Neural Architecture Search with Disentangled Self-supervision Collection

2023.

3083.

(Ed.)

MathNAS: If Blocks Have a Role in Mathematical Architecture Design Collection

2023.

3082.

(Ed.)

KD-Zero: Evolving Knowledge Distiller for Any Teacher-Student Pairs Collection

2023.

3081.

(Ed.)

Analyzing Generalization of Neural Networks through Loss Path Kernels Collection

2023.

3080.

(Ed.)

Operation-Level Early Stopping for Robustifying Differentiable NAS Collection

2023.

3079.

(Ed.)

AutoGO: Automated Computation Graph Optimization for Neural Network Evolution Collection

2023.

3078.

(Ed.)

Building A Mobile Text Recognizer via Truncated SVD-based Knowledge Distillation-Guided NAS Collection

2023.

3077.

Wang, Shang; Tang, Huangrong

GRADIENT-FREE PROXY FOR EFFICIENT LANGUAGE MODEL SEARCH Technical Report

2023.

3076.

Hundhausen, Felix; Hubschneider, Simon; Asfou, Tamim

Grasping with Humanoid Hands based on In-Hand Vision and Hardware-accelerated CNNs Technical Report

2023.

3075.

Xue, Yu; Tong, Weinan; Neri, Ferrante; Chen, Peng; Luo, Tao; Zhen, Liangli; Wang, Xiao

Evolutionary Architecture Search for Generative Adversarial Networks Based On Weight Sharing Technical Report

2023.

3074.

Al-Sabri, Raeed; Gao, Jianliang; Chen, Jiamin; Oloulade, Babatounde Moctard; Lyu, Tengfei

AutoTGRL: an automatic text-graph representation learning framework Journal Article

In: Neural Computing and Applications, 2023.

3073.

SASNAUSKAS, PAULIUS; PETKEVIČIUS, INAS

Symbolic Neural Architecture Search for Differential Equations Journal Article

In: 2023.

3072.

Luo, Xiangzhong

Hardware-aware neural architecture search and compression towards embedded intelligence PhD Thesis

2023.

3271 entries « ‹ 4 of 66 › »