AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4218 entries « 27 of 85 »

2023

2918.

Verma, Monu; Lubal, Priyanka; Vipparthi, Santosh Kumar; Abdel-Mottaleb, Mohamed

RNAS-MER: A Refined Neural Architecture Search With Hybrid Spatiotemporal Operations for Micro-Expression Recognition Proceedings Article

In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 4770-4779, 2023.

Links | BibTeX

2917.

Nagpure, Vikrant; Okuma, Kenji

Searching Efficient Neural Architecture With Multi-Resolution Fusion Transformer for Appearance-Based Gaze Estimation Proceedings Article

In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 890-899, 2023.

Links | BibTeX

2916.

Ahn, Daehyun; Kim, Hyungjun; Kim, Taesu; Park, Eunhyeok; Kim, Jae-Joon

Searching for Robust Binary Neural Networks via Bimodal Parameter Perturbation Proceedings Article

In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 2410-2419, 2023.

Links | BibTeX

2915.

Li, Yinqiao; Cao, Runzhe; He, Qiaozhi; Xiao, Tong; Zhu, Jingbo

Learning Reliable Neural Networks with Distributed Architecture Representations Journal Article

In: ACM Trans. Asian Low-Resour. Lang. Inf. Process., 2023, ISSN: 2375-4699, (Just Accepted).

Abstract | Links | BibTeX

2914.

Ahmadian, Arash; Fei, Yue; Liu, Louis S. P.; Plataniotis, Konstantinos N.; Hosseini, Mahdi S.

Pseudo-Inverted Bottleneck Convolution for DARTS Search Space Technical Report

2023.

Links | BibTeX

2913.

Ding, Li; Spector, Lee

Multi-Objective Evolutionary Architecture Search for Parameterized Quantum Circuits Journal Article

In: Entropy, vol. 25, no. 1, 2023, ISSN: 1099-4300.

Abstract | Links | BibTeX

2912.

Saeed, Fahman; Hussain, Muhammad; Aboalsamh, Hatim A.; Adel, Fadwa Al; Owaifeer, Adi Mohammed Al

Designing the Architecture of a Convolutional Neural Network Automatically for Diabetic Retinopathy Diagnosis Journal Article

In: Mathematics, vol. 11, no. 2, 2023, ISSN: 2227-7390.

Abstract | Links | BibTeX

2911.

Magalhães, Dimmy; Lima, Ricardo H. R.; Pozo, Aurora

Creating deep neural networks for text classification tasks using grammar genetic programming Journal Article

In: Applied Soft Computing, pp. 110009, 2023, ISSN: 1568-4946.

Abstract | Links | BibTeX

2910.

Li, Xingzhuo; Hou, Sujuan; Zhang, Baisong; Wang, Jing; Jia, Weikuan; Zheng, Yuanjie

Long-Range Dependence Involutional Network for Logo Detection Journal Article

In: Entropy, vol. 25, no. 1, 2023, ISSN: 1099-4300.

Abstract | Links | BibTeX

2909.

Xie, Xiangning; Song, Xiaotian; Lv, Zeqiong; Yen, Gary G.; Ding, Weiping; Sun, Yanan

Efficient Evaluation Methods for Neural Architecture Search: A Survey Technical Report

2023.

Links | BibTeX

2908.

Lee, Seunghyun; Song, Byung Cheol

Fast Filter Pruning via Coarse-to-Fine Neural Architecture Search and Contrastive Knowledge Transfer Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-12, 2023.

Links | BibTeX

2907.

Chauhan, Anshumaan; Bhattacharyya, Siddhartha; Vadivel, S.

DQNAS: Neural Architecture Search using Reinforcement Learning Technical Report

2023.

Links | BibTeX

2906.

Ye, Peng; He, Tong; Li, Baopu; Chen, Tao; Bai, Lei; Ouyang, Wanli

(beta)-DARTS++: Bi-level Regularization for Proxy-robust Differentiable Architecture Search Technical Report

2023.

Links | BibTeX

2905.

Ford, Noah; Winder, John; McClellan, Josh

Adaptive Neural Networks Using Residual Fitting Technical Report

2023.

Links | BibTeX

2904.

Lakhmiri, Dounia; Zolnouri, Mahdi; Nia, Vahid Partovi; Tribes, Christophe; Digabel, Sébastien Le

Scaling Deep Networks with the Mesh Adaptive Direct Search algorithm Technical Report

2023.

Links | BibTeX

2903.

White, Colin; Safari, Mahmoud; Sukthanker, Rhea; Ru, Binxin; Elsken, Thomas; Zela, Arber; Dey, Debadeepta; Hutter, Frank

Neural Architecture Search: Insights from 1000 Papers Technical Report

2023.

Links | BibTeX

2902.

Kong, Gangwei; Li, Chang; Peng, Hu; Han, Zhihui; Qiao, Heyuan

EEG-Based Sleep Stage Classification via Neural Architecture Search Journal Article

In: IEEE transactions on neural systems and rehabilitation engineering: a publication of the IEEE Engineering in Medicine and Biology Society, 2023.

Links | BibTeX

2901.

Shi, Chaokun; Hao, Yuexing; Li, Gongyan; Xu, Shaoyun

EBNAS: Efficient binary network design for image classification via neural architecture search Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 120, pp. 105845, 2023, ISSN: 0952-1976.

Abstract | Links | BibTeX

2900.

Nath, Utkarsh; Wang, Yancheng; Yang, Yingzhen

RNAS-CL: Robust Neural Architecture Search by Cross-Layer Knowledge Distillation Technical Report

2023.

Links | BibTeX

2899.

Jin, Haifeng; Chollet, François; Song, Qingquan; Hu, Xia

AutoKeras: An AutoML Library for Deep Learning Journal Article

In: Journal of Machine Learning Research, vol. 24, no. 6, pp. 1–6, 2023.

Links | BibTeX

2898.

Carrasquilla, Juan; Hibat-Allah, Mohamed; Inack, Estelle; Makhzani, Alireza; Neklyudov, Kirill; Taylor, Graham W.; Torlai, Giacomo

Quantum HyperNetworks: Training Binary Neural Networks in Quantum Superposition Technical Report

2023.

Links | BibTeX

2897.

Shi, Chaokun; Hao, Yuexing; Li, Gongyan; Xu, Shaoyun

EBNAS: Efficient binary network design for image classification via neural architecture search Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 120, pp. 105845, 2023, ISSN: 0952-1976.

Abstract | Links | BibTeX

2896.

Eminaga, Okyaz; Abbas, Mahmoud; Shen, Jeanne; Laurie, Mark; Brooks, James D.; Liao, Joseph C.; Rubin, Daniel L.

PlexusNet: A neural network architectural concept for medical image classification Journal Article

In: Computers in Biology and Medicine, pp. 106594, 2023, ISSN: 0010-4825.

Abstract | Links | BibTeX

2895.

Dong, Peijie; Niu, Xin; Li, Lujun; Tian, Zhiliang; Wang, Xiaodong; Wei, Zimian; Pan, Hengyue; Li, Dongsheng

RD-NAS: Enhancing One-shot Supernet Ranking Ability via Ranking Distillation from Zero-cost Proxies Technical Report

2023.

Links | BibTeX

2894.

Zolnouri, Mahdi; Lakhmiri, Dounia; Tribes, Christophe; Sari, Eyyüb; Digabel, Sébastien Le

Efficient Training Under Limited Resources Technical Report

2023.

Links | BibTeX

2893.

Thomas, Jibin B.; K.V., Shihabudheen

Neural architecture search algorithm to optimize deep Transformer model for fault detection in electrical power distribution systems Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 120, pp. 105890, 2023, ISSN: 0952-1976.

Abstract | Links | BibTeX

2892.

An, Yang; Zhang, Changsheng; Zheng, Xuanyu

Knowledge reconstruction assisted evolutionary algorithm for neural network architecture search Journal Article

In: Knowledge-Based Systems, vol. 264, pp. 110341, 2023, ISSN: 0950-7051.

Abstract | Links | BibTeX

2891.

Li, Guihong; Yang, Yuedong; Bhardwaj, Kartikeya; Marculescu, Radu

ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Proceedings Article

In: ICLR 2023, 2023.

Links | BibTeX

2890.

Liu, Yukun; Li, Ta; Zhang, Pengyuan; Yan, Yonghong

LWMD: A Comprehensive Compression Platform for End-to-End Automatic Speech Recognition Models Journal Article

In: Applied Sciences, vol. 13, no. 3, 2023, ISSN: 2076-3417.

Abstract | Links | BibTeX

2889.

Son, David; Putter, Floran; Vogel, Sebastian; Corporaal, Henk

BOMP-NAS: Bayesian Optimization Mixed Precision NAS Technical Report

2023.

Links | BibTeX

2888.

Wang, Yawen; Zhang, Shihua

Prediction of Tumor Lymph Node Metastasis Using Wasserstein Distance-Based Generative Adversarial Networks Combing with Neural Architecture Search for Predicting Journal Article

In: Mathematics, vol. 11, no. 3, 2023, ISSN: 2227-7390.

Abstract | Links | BibTeX

2887.

Vidnerová, Petra; Kalina, Jan

Multi-objective Bayesian Optimization for Neural Architecture Search Proceedings Article

In: Rutkowski, Leszek; Scherer, Rafał; Korytkowski, Marcin; Pedrycz, Witold; Tadeusiewicz, Ryszard; Zurada, Jacek M. (Ed.): Ärtificial Intelligence and Soft Computing", pp. 144–153, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-23492-7.

Abstract | Links | BibTeX

2886.

Huang, Lan; Sun, Shiqi; Zeng, Jia; Wang, Wencong; Pang, Wei; Wang, Kangping

U-DARTS: Uniform-space differentiable architecture search Journal Article

In: Information Sciences, vol. 628, pp. 339-349, 2023, ISSN: 0020-0255.

Abstract | Links | BibTeX

2885.

Ji, Zhanghexuan; Guo, Dazhou; Wang, Puyang; Yan, Ke; Lu, Le; Xu, Minfeng; Zhou, Jingren; Wang, Qifeng; Ge, Jia; Gao, Mingchen; Ye, Xianghua; Jin, Dakai

Continual Segment: Towards a Single, Unified and Accessible Continual Segmentation Model of 143 Whole-body Organs in CT Scans Technical Report

2023.

Links | BibTeX

2884.

Kang, Jeon-Seong; Kang, JinKyu; Kim, Jung-Jun; Jeon, Kwang-Woo; Chung, Hyun-Joon; Park, Byung-Hoon

Neural Architecture Search Survey: A Computer Vision Perspective Journal Article

In: Sensors, vol. 23, no. 3, 2023, ISSN: 1424-8220.

Abstract | Links | BibTeX

2883.

Rampavan, Medipelly; Ijjina, Earnest Paul

Genetic brake-net: Deep learning based brake light detection for collision avoidance using genetic algorithm Journal Article

In: Knowledge-Based Systems, pp. 110338, 2023, ISSN: 0950-7051.

Abstract | Links | BibTeX

2882.

Sarti, Simone; Lomurno, Eugenio; Falanti, Andrea; Matteucci, Matteo

Enhancing Once-For-All: A Study on Parallel Blocks, Skip Connections and Early Exits Technical Report

2023.

Links | BibTeX

2881.

Kulbach, Cedric Peter Charles

Adaptive Automated Machine Learning PhD Thesis

Karlsruher Institut für Technologie (KIT), 2023.

Links | BibTeX

2880.

Wang, Chao; Jiao, Licheng; Zhao, Jiaxuan; Li, Lingling; Liu, Xu; Liu, Fang; Yang, Shuyuan

Bi-level Multi-objective Evolutionary Learning: A Case Study on Multi-task Graph Neural Topology Search Technical Report

2023.

Links | BibTeX

2879.

Gao, Yang; Zhang, Peng; Zhou, Chuan; Yang, Hong; Li, Zhao; Hu, Yue; Yu, Philip S.

HGNAS++: Efficient Architecture Search for Heterogeneous Graph Neural Networks Journal Article

In: IEEE Transactions on Knowledge and Data Engineering, pp. 1-14, 2023.

Links | BibTeX

2878.

Zhou, Yuan; Hao, Jieke; Huo, Shuwei; Wang, Boyu; Ge, Leijiao; Kung, Sun-Yuan

Automatic Metric Search for Few-Shot Learning Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-12, 2023.

Links | BibTeX

2877.

Äkiva-Hochman, Ruth; Finder, Shahaf E.; Turek, Javier S.; Treister, Eran"

Searching for N:M Fine-grained Sparsity of Weights and Activations in Neural Networks Proceedings Article

In: Karlinsky, Leonid; Michaeli, Tomer; Nishino, Ko (Ed.): Computer Vision -- ECCV 2022 Workshops, pp. 130–143, Springer Nature Switzerland, Cham, 2023, ISBN: 978-3-031-25082-8.

Abstract | BibTeX

2876.

Ünal, Hamit Taner; Başçiftçi, Fatih

Neural Logic Circuits: An evolutionary neural architecture that can learn and generalize Journal Article

In: Knowledge-Based Systems, vol. 265, pp. 110379, 2023, ISSN: 0950-7051.

Abstract | Links | BibTeX

2875.

Jin, Guangyin; Sha, Hengyu; Xi, Zhexu; Huang, Jincai

Urban hotspot forecasting via automated spatio-temporal information fusion Journal Article

In: Applied Soft Computing, vol. 136, pp. 110087, 2023, ISSN: 1568-4946.

Abstract | Links | BibTeX

2874.

Huang, Mingqiang; Liu, Yucen; Huang, Sixiao; Li, Kai; Wu, Qiuping; Yu, Hao

Multi-Bit-Width CNN Accelerator with Systolic-in-Systolic Dataflow and Single DSP Multiple Multiplication Scheme Proceedings Article

In: Proceedings of the 2023 ACM/SIGDA International Symposium on Field Programmable Gate Arrays, pp. 229, Association for Computing Machinery, Monterey, CA, USA, 2023, ISBN: 9781450394178.

Abstract | Links | BibTeX

2873.

Wang, Xueying; Li, Guangli; Ma, Xiu; Feng, Xiaobing

Facilitating hardware-aware neural architecture search with learning-based predictive models Journal Article

In: Journal of Systems Architecture, vol. 137, pp. 102838, 2023, ISSN: 1383-7621.

Abstract | Links | BibTeX

2872.

Chatzianastasis, Michail; Ilias, Loukas; Askounis, Dimitris; Vazirgiannis, Michalis

Neural Architecture Search with Multimodal Fusion Methods for Diagnosing Dementia Technical Report

2023.

Links | BibTeX

2871.

Zhu, Xunyu; Li, Jian; Liu, Yong; Wang, Weiping

Improving Differentiable Architecture Search via Self-Distillation Technical Report

2023.

Links | BibTeX

2870.

Wang, Zhe; Yang, Fangfang; Xu, Qiang; Wang, Yongjian; Yan, Hong; Xie, Min

Capacity estimation of lithium-ion batteries based on data aggregation and feature fusion via graph neural network Journal Article

In: Applied Energy, vol. 336, pp. 120808, 2023, ISSN: 0306-2619.

Abstract | Links | BibTeX

2869.

Ismail, Walaa N.; Alsalamah, Hessah A.; Hassan, Mohammad Mehedi; Mohamed, Ebtesam

AUTO-HAR: An adaptive human activity recognition framework using an automated CNN architecture design Journal Article

In: Heliyon, vol. 9, no. 2, pp. e13636, 2023, ISSN: 2405-8440.

Abstract | Links | BibTeX

4218 entries « 27 of 85 »