AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4236 entries « 27 of 85 »

2023

2936.

Souquet, Léo; Shvai, Nadiya; Llanza, Arcadi; Nakib, Amir

Convolutional neural network architecture search based on fractal decomposition optimization algorithm Journal Article

In: Expert Systems with Applications, vol. 213, pp. 118947, 2023, ISSN: 0957-4174.

Abstract | Links | BibTeX

2935.

Wen, Yingpeng; Yu, Weijiang; Li, Dongsheng; Du, Jiangsu; Huang, Dan; Xiao, Nong

CosNAS: Enhancing estimation on cosmological parameters via neural architecture search Journal Article

In: New Astronomy, vol. 99, pp. 101955, 2023, ISSN: 1384-1076.

Abstract | Links | BibTeX

2934.

Li, Chuanyou; Zhang, Kun; Li, Yifan; Shang, Jiangwei; Zhang, Xinyue; Qian, Lei

ANNA: Accelerating Neural Network Accelerator through software-hardware co-design for vertical applications in edge systems Journal Article

In: Future Generation Computer Systems, vol. 140, pp. 91-103, 2023, ISSN: 0167-739X.

Abstract | Links | BibTeX

2933.

Zharikov, Ilia; Krivorotov, Ivan; Maximov, Egor; Korviakov, Vladimir; Letunovskiy, Alexey

Ä Review of One-Shot Neural Architecture Search Methods Proceedings Article

In: Kryzhanovsky, Boris; Dunin-Barkowski, Witali; Redko, Vladimir; Tiumentsev, Yury (Ed.): Ädvances in Neural Computation, Machine Learning, and Cognitive Research VI", pp. 130–147, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-19032-2.

Abstract | BibTeX

2932.

Kolganov, Pavel A.; Tiumentsev, Yury V.

Än Attempt to Formalize the Formulation of the Network Architecture Search Problem for Convolutional Neural Networks Proceedings Article

In: Kryzhanovsky, Boris; Dunin-Barkowski, Witali; Redko, Vladimir; Tiumentsev, Yury (Ed.): Ädvances in Neural Computation, Machine Learning, and Cognitive Research VI", pp. 550–556, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-19032-2.

Abstract | BibTeX

2931.

Graham-Knight, John Brandon; Bond, Corey; Najjaran, Homayoun; Lucet, Yves; Lasserre, Patricia

Predicting and explaining performance and diversity of neural network architecture for semantic segmentation Journal Article

In: Expert Systems with Applications, vol. 214, pp. 119101, 2023, ISSN: 0957-4174.

Abstract | Links | BibTeX

2930.

Sun, Yanan; Yen, Gary G.; Zhang, Mengjie

End-to-End Performance Predictors Book Chapter

In: Evolutionary Deep Neural Architecture Search: Fundamentals, Methods, and Recent Advances, pp. 237–255, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-16868-0.

Abstract | Links | BibTeX

2929.

Sun, Yanan; Yen, Gary G.; Zhang, Mengjie

Hybrid GA and PSO for Architecture Design Book Chapter

In: Evolutionary Deep Neural Architecture Search: Fundamentals, Methods, and Recent Advances, pp. 171–180, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-16868-0.

Abstract | Links | BibTeX

2928.

Sun, Yanan; Yen, Gary G.; Zhang, Mengjie

Architecture Design for Skip-Connection Based CNNs Book Chapter

In: Evolutionary Deep Neural Architecture Search: Fundamentals, Methods, and Recent Advances, pp. 147–170, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-16868-0.

Abstract | Links | BibTeX

2927.

Sun, Yanan; Yen, Gary G.; Zhang, Mengjie

Differential Evolution for Architecture Design Book Chapter

In: Evolutionary Deep Neural Architecture Search: Fundamentals, Methods, and Recent Advances, pp. 193–202, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-16868-0.

Abstract | Links | BibTeX

2926.

Jing, Kun; Chen, Luoyu; Xu, Jungang

An architecture entropy regularizer for differentiable neural architecture search Journal Article

In: Neural Networks, vol. 158, pp. 111-120, 2023, ISSN: 0893-6080.

Abstract | Links | BibTeX

2925.

Yao, Fengqin; Wang, Shengke; Ding, Laihui; Zhong, Guoqiang; Bullock, Leon Bevan; Xu, Zhiwei; Dong, Junyu

Lightweight network learning with Zero-Shot Neural Architecture Search for UAV images Journal Article

In: Knowledge-Based Systems, vol. 260, pp. 110142, 2023, ISSN: 0950-7051.

Abstract | Links | BibTeX

2924.

Wang, Wenna; Zhang, Xiuwei; Cui, Hengfei; Yin, Hanlin; Zhang, Yannnig

FP-DARTS: Fast parallel differentiable neural architecture search for image classification Journal Article

In: Pattern Recognition, vol. 136, pp. 109193, 2023, ISSN: 0031-3203.

Abstract | Links | BibTeX

2923.

Jin, Cong; Huang, Jinjie; Wei, Tianshu; Chen, Yuanjian

Neural architecture search based on dual attention mechanism for image classification Journal Article

In: Mathematical Biosciences and Engineering, vol. 20, no. 2, pp. 2691-2715, 2023, ISSN: 1551-0018.

Links | BibTeX

2922.

Jin, Yaochu; Zhu, Hangyu; Xu, Jinjin; Chen, Yang

Evolutionary Multi-objective Federated Learning Book Chapter

In: Federated Learning: Fundamentals and Advances, pp. 139–164, Springer Nature Singapore, Singapore, 2023, ISBN: 978-981-19-7083-2.

Abstract | Links | BibTeX

2921.

Lyu, Bo; Lu, Longfei; Hamdi, Maher; Wen, Shiping; Yang, Yin; Li, Ke

MTLP-JR: Multi-task learning-based prediction for joint ranking in neural architecture search Journal Article

In: Computers and Electrical Engineering, vol. 105, pp. 108474, 2023, ISSN: 0045-7906.

Abstract | Links | BibTeX

2920.

Gudzius, Povilas; Kurasova, Olga; Darulis, Vytenis; Filatovas, Ernestas

AutoML-Based Neural Architecture Search for Object Recognition in Satellite Imagery Journal Article

In: Remote Sensing, vol. 15, no. 1, 2023, ISSN: 2072-4292.

Abstract | Links | BibTeX

2919.

Wang, Xiaojuan; He, Mingshu; Yang, Liu; Wang, Hui; Zhong, Yun

Human Activity Recognition Based on an Efficient Neural Architecture Search Framework Using Evolutionary Multi-Objective Surrogate-Assisted Algorithms Journal Article

In: Electronics, vol. 12, no. 1, 2023, ISSN: 2079-9292.

Abstract | Links | BibTeX

2918.

Verma, Monu; Lubal, Priyanka; Vipparthi, Santosh Kumar; Abdel-Mottaleb, Mohamed

RNAS-MER: A Refined Neural Architecture Search With Hybrid Spatiotemporal Operations for Micro-Expression Recognition Proceedings Article

In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 4770-4779, 2023.

Links | BibTeX

2917.

Nagpure, Vikrant; Okuma, Kenji

Searching Efficient Neural Architecture With Multi-Resolution Fusion Transformer for Appearance-Based Gaze Estimation Proceedings Article

In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 890-899, 2023.

Links | BibTeX

2916.

Ahn, Daehyun; Kim, Hyungjun; Kim, Taesu; Park, Eunhyeok; Kim, Jae-Joon

Searching for Robust Binary Neural Networks via Bimodal Parameter Perturbation Proceedings Article

In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 2410-2419, 2023.

Links | BibTeX

2915.

Li, Yinqiao; Cao, Runzhe; He, Qiaozhi; Xiao, Tong; Zhu, Jingbo

Learning Reliable Neural Networks with Distributed Architecture Representations Journal Article

In: ACM Trans. Asian Low-Resour. Lang. Inf. Process., 2023, ISSN: 2375-4699, (Just Accepted).

Abstract | Links | BibTeX

2914.

Ahmadian, Arash; Fei, Yue; Liu, Louis S. P.; Plataniotis, Konstantinos N.; Hosseini, Mahdi S.

Pseudo-Inverted Bottleneck Convolution for DARTS Search Space Technical Report

2023.

Links | BibTeX

2913.

Ding, Li; Spector, Lee

Multi-Objective Evolutionary Architecture Search for Parameterized Quantum Circuits Journal Article

In: Entropy, vol. 25, no. 1, 2023, ISSN: 1099-4300.

Abstract | Links | BibTeX

2912.

Saeed, Fahman; Hussain, Muhammad; Aboalsamh, Hatim A.; Adel, Fadwa Al; Owaifeer, Adi Mohammed Al

Designing the Architecture of a Convolutional Neural Network Automatically for Diabetic Retinopathy Diagnosis Journal Article

In: Mathematics, vol. 11, no. 2, 2023, ISSN: 2227-7390.

Abstract | Links | BibTeX

2911.

Magalhães, Dimmy; Lima, Ricardo H. R.; Pozo, Aurora

Creating deep neural networks for text classification tasks using grammar genetic programming Journal Article

In: Applied Soft Computing, pp. 110009, 2023, ISSN: 1568-4946.

Abstract | Links | BibTeX

2910.

Li, Xingzhuo; Hou, Sujuan; Zhang, Baisong; Wang, Jing; Jia, Weikuan; Zheng, Yuanjie

Long-Range Dependence Involutional Network for Logo Detection Journal Article

In: Entropy, vol. 25, no. 1, 2023, ISSN: 1099-4300.

Abstract | Links | BibTeX

2909.

Xie, Xiangning; Song, Xiaotian; Lv, Zeqiong; Yen, Gary G.; Ding, Weiping; Sun, Yanan

Efficient Evaluation Methods for Neural Architecture Search: A Survey Technical Report

2023.

Links | BibTeX

2908.

Lee, Seunghyun; Song, Byung Cheol

Fast Filter Pruning via Coarse-to-Fine Neural Architecture Search and Contrastive Knowledge Transfer Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-12, 2023.

Links | BibTeX

2907.

Chauhan, Anshumaan; Bhattacharyya, Siddhartha; Vadivel, S.

DQNAS: Neural Architecture Search using Reinforcement Learning Technical Report

2023.

Links | BibTeX

2906.

Ye, Peng; He, Tong; Li, Baopu; Chen, Tao; Bai, Lei; Ouyang, Wanli

(beta)-DARTS++: Bi-level Regularization for Proxy-robust Differentiable Architecture Search Technical Report

2023.

Links | BibTeX

2905.

Ford, Noah; Winder, John; McClellan, Josh

Adaptive Neural Networks Using Residual Fitting Technical Report

2023.

Links | BibTeX

2904.

Lakhmiri, Dounia; Zolnouri, Mahdi; Nia, Vahid Partovi; Tribes, Christophe; Digabel, Sébastien Le

Scaling Deep Networks with the Mesh Adaptive Direct Search algorithm Technical Report

2023.

Links | BibTeX

2903.

White, Colin; Safari, Mahmoud; Sukthanker, Rhea; Ru, Binxin; Elsken, Thomas; Zela, Arber; Dey, Debadeepta; Hutter, Frank

Neural Architecture Search: Insights from 1000 Papers Technical Report

2023.

Links | BibTeX

2902.

Kong, Gangwei; Li, Chang; Peng, Hu; Han, Zhihui; Qiao, Heyuan

EEG-Based Sleep Stage Classification via Neural Architecture Search Journal Article

In: IEEE transactions on neural systems and rehabilitation engineering: a publication of the IEEE Engineering in Medicine and Biology Society, 2023.

Links | BibTeX

2901.

Shi, Chaokun; Hao, Yuexing; Li, Gongyan; Xu, Shaoyun

EBNAS: Efficient binary network design for image classification via neural architecture search Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 120, pp. 105845, 2023, ISSN: 0952-1976.

Abstract | Links | BibTeX

2900.

Nath, Utkarsh; Wang, Yancheng; Yang, Yingzhen

RNAS-CL: Robust Neural Architecture Search by Cross-Layer Knowledge Distillation Technical Report

2023.

Links | BibTeX

2899.

Jin, Haifeng; Chollet, François; Song, Qingquan; Hu, Xia

AutoKeras: An AutoML Library for Deep Learning Journal Article

In: Journal of Machine Learning Research, vol. 24, no. 6, pp. 1–6, 2023.

Links | BibTeX

2898.

Carrasquilla, Juan; Hibat-Allah, Mohamed; Inack, Estelle; Makhzani, Alireza; Neklyudov, Kirill; Taylor, Graham W.; Torlai, Giacomo

Quantum HyperNetworks: Training Binary Neural Networks in Quantum Superposition Technical Report

2023.

Links | BibTeX

2897.

Shi, Chaokun; Hao, Yuexing; Li, Gongyan; Xu, Shaoyun

EBNAS: Efficient binary network design for image classification via neural architecture search Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 120, pp. 105845, 2023, ISSN: 0952-1976.

Abstract | Links | BibTeX

2896.

Eminaga, Okyaz; Abbas, Mahmoud; Shen, Jeanne; Laurie, Mark; Brooks, James D.; Liao, Joseph C.; Rubin, Daniel L.

PlexusNet: A neural network architectural concept for medical image classification Journal Article

In: Computers in Biology and Medicine, pp. 106594, 2023, ISSN: 0010-4825.

Abstract | Links | BibTeX

2895.

Dong, Peijie; Niu, Xin; Li, Lujun; Tian, Zhiliang; Wang, Xiaodong; Wei, Zimian; Pan, Hengyue; Li, Dongsheng

RD-NAS: Enhancing One-shot Supernet Ranking Ability via Ranking Distillation from Zero-cost Proxies Technical Report

2023.

Links | BibTeX

2894.

Zolnouri, Mahdi; Lakhmiri, Dounia; Tribes, Christophe; Sari, Eyyüb; Digabel, Sébastien Le

Efficient Training Under Limited Resources Technical Report

2023.

Links | BibTeX

2893.

Thomas, Jibin B.; K.V., Shihabudheen

Neural architecture search algorithm to optimize deep Transformer model for fault detection in electrical power distribution systems Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 120, pp. 105890, 2023, ISSN: 0952-1976.

Abstract | Links | BibTeX

2892.

An, Yang; Zhang, Changsheng; Zheng, Xuanyu

Knowledge reconstruction assisted evolutionary algorithm for neural network architecture search Journal Article

In: Knowledge-Based Systems, vol. 264, pp. 110341, 2023, ISSN: 0950-7051.

Abstract | Links | BibTeX

2891.

Li, Guihong; Yang, Yuedong; Bhardwaj, Kartikeya; Marculescu, Radu

ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Proceedings Article

In: ICLR 2023, 2023.

Links | BibTeX

2890.

Liu, Yukun; Li, Ta; Zhang, Pengyuan; Yan, Yonghong

LWMD: A Comprehensive Compression Platform for End-to-End Automatic Speech Recognition Models Journal Article

In: Applied Sciences, vol. 13, no. 3, 2023, ISSN: 2076-3417.

Abstract | Links | BibTeX

2889.

Son, David; Putter, Floran; Vogel, Sebastian; Corporaal, Henk

BOMP-NAS: Bayesian Optimization Mixed Precision NAS Technical Report

2023.

Links | BibTeX

2888.

Wang, Yawen; Zhang, Shihua

Prediction of Tumor Lymph Node Metastasis Using Wasserstein Distance-Based Generative Adversarial Networks Combing with Neural Architecture Search for Predicting Journal Article

In: Mathematics, vol. 11, no. 3, 2023, ISSN: 2227-7390.

Abstract | Links | BibTeX

2887.

Vidnerová, Petra; Kalina, Jan

Multi-objective Bayesian Optimization for Neural Architecture Search Proceedings Article

In: Rutkowski, Leszek; Scherer, Rafał; Korytkowski, Marcin; Pedrycz, Witold; Tadeusiewicz, Ryszard; Zurada, Jacek M. (Ed.): Ärtificial Intelligence and Soft Computing", pp. 144–153, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-23492-7.

Abstract | Links | BibTeX

4236 entries « 27 of 85 »