AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


2464 entries « 2 of 50 »

2023

2414.

Ding, Li; Spector, Lee

Multi-Objective Evolutionary Architecture Search for Parameterized Quantum Circuits Journal Article

In: Entropy, vol. 25, no. 1, 2023, ISSN: 1099-4300.

Abstract | Links | BibTeX

2413.

Saeed, Fahman; Hussain, Muhammad; Aboalsamh, Hatim A.; Adel, Fadwa Al; Owaifeer, Adi Mohammed Al

Designing the Architecture of a Convolutional Neural Network Automatically for Diabetic Retinopathy Diagnosis Journal Article

In: Mathematics, vol. 11, no. 2, 2023, ISSN: 2227-7390.

Abstract | Links | BibTeX

2412.

Magalhães, Dimmy; Lima, Ricardo H. R.; Pozo, Aurora

Creating deep neural networks for text classification tasks using grammar genetic programming Journal Article

In: Applied Soft Computing, pp. 110009, 2023, ISSN: 1568-4946.

Abstract | Links | BibTeX

2411.

Li, Xingzhuo; Hou, Sujuan; Zhang, Baisong; Wang, Jing; Jia, Weikuan; Zheng, Yuanjie

Long-Range Dependence Involutional Network for Logo Detection Journal Article

In: Entropy, vol. 25, no. 1, 2023, ISSN: 1099-4300.

Abstract | Links | BibTeX

2410.

Xie, Xiangning; Song, Xiaotian; Lv, Zeqiong; Yen, Gary G.; Ding, Weiping; Sun, Yanan

Efficient Evaluation Methods for Neural Architecture Search: A Survey Technical Report

2023.

Links | BibTeX

2409.

Lee, Seunghyun; Song, Byung Cheol

Fast Filter Pruning via Coarse-to-Fine Neural Architecture Search and Contrastive Knowledge Transfer Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-12, 2023.

Links | BibTeX

2408.

Chauhan, Anshumaan; Bhattacharyya, Siddhartha; Vadivel, S.

DQNAS: Neural Architecture Search using Reinforcement Learning Technical Report

2023.

Links | BibTeX

2407.

Ye, Peng; He, Tong; Li, Baopu; Chen, Tao; Bai, Lei; Ouyang, Wanli

(beta)-DARTS++: Bi-level Regularization for Proxy-robust Differentiable Architecture Search Technical Report

2023.

Links | BibTeX

2406.

Ford, Noah; Winder, John; McClellan, Josh

Adaptive Neural Networks Using Residual Fitting Technical Report

2023.

Links | BibTeX

2405.

Lakhmiri, Dounia; Zolnouri, Mahdi; Nia, Vahid Partovi; Tribes, Christophe; Digabel, Sébastien Le

Scaling Deep Networks with the Mesh Adaptive Direct Search algorithm Technical Report

2023.

Links | BibTeX

2404.

White, Colin; Safari, Mahmoud; Sukthanker, Rhea; Ru, Binxin; Elsken, Thomas; Zela, Arber; Dey, Debadeepta; Hutter, Frank

Neural Architecture Search: Insights from 1000 Papers Technical Report

2023.

Links | BibTeX

2403.

Kong, Gangwei; Li, Chang; Peng, Hu; Han, Zhihui; Qiao, Heyuan

EEG-Based Sleep Stage Classification via Neural Architecture Search Journal Article

In: IEEE transactions on neural systems and rehabilitation engineering: a publication of the IEEE Engineering in Medicine and Biology Society, 2023.

Links | BibTeX

2402.

Shi, Chaokun; Hao, Yuexing; Li, Gongyan; Xu, Shaoyun

EBNAS: Efficient binary network design for image classification via neural architecture search Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 120, pp. 105845, 2023, ISSN: 0952-1976.

Abstract | Links | BibTeX

2401.

Nath, Utkarsh; Wang, Yancheng; Yang, Yingzhen

RNAS-CL: Robust Neural Architecture Search by Cross-Layer Knowledge Distillation Technical Report

2023.

Links | BibTeX

2400.

Jin, Haifeng; Chollet, François; Song, Qingquan; Hu, Xia

AutoKeras: An AutoML Library for Deep Learning Journal Article

In: Journal of Machine Learning Research, vol. 24, no. 6, pp. 1–6, 2023.

Links | BibTeX

2399.

Carrasquilla, Juan; Hibat-Allah, Mohamed; Inack, Estelle; Makhzani, Alireza; Neklyudov, Kirill; Taylor, Graham W.; Torlai, Giacomo

Quantum HyperNetworks: Training Binary Neural Networks in Quantum Superposition Technical Report

2023.

Links | BibTeX

2398.

Shi, Chaokun; Hao, Yuexing; Li, Gongyan; Xu, Shaoyun

EBNAS: Efficient binary network design for image classification via neural architecture search Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 120, pp. 105845, 2023, ISSN: 0952-1976.

Abstract | Links | BibTeX

2397.

Eminaga, Okyaz; Abbas, Mahmoud; Shen, Jeanne; Laurie, Mark; Brooks, James D.; Liao, Joseph C.; Rubin, Daniel L.

PlexusNet: A neural network architectural concept for medical image classification Journal Article

In: Computers in Biology and Medicine, pp. 106594, 2023, ISSN: 0010-4825.

Abstract | Links | BibTeX

2396.

Dong, Peijie; Niu, Xin; Li, Lujun; Tian, Zhiliang; Wang, Xiaodong; Wei, Zimian; Pan, Hengyue; Li, Dongsheng

RD-NAS: Enhancing One-shot Supernet Ranking Ability via Ranking Distillation from Zero-cost Proxies Technical Report

2023.

Links | BibTeX

2395.

Zolnouri, Mahdi; Lakhmiri, Dounia; Tribes, Christophe; Sari, Eyyüb; Digabel, Sébastien Le

Efficient Training Under Limited Resources Technical Report

2023.

Links | BibTeX

2394.

Thomas, Jibin B.; K.V., Shihabudheen

Neural architecture search algorithm to optimize deep Transformer model for fault detection in electrical power distribution systems Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 120, pp. 105890, 2023, ISSN: 0952-1976.

Abstract | Links | BibTeX

2393.

An, Yang; Zhang, Changsheng; Zheng, Xuanyu

Knowledge reconstruction assisted evolutionary algorithm for neural network architecture search Journal Article

In: Knowledge-Based Systems, vol. 264, pp. 110341, 2023, ISSN: 0950-7051.

Abstract | Links | BibTeX

2392.

Li, Guihong; Yang, Yuedong; Bhardwaj, Kartikeya; Marculescu, Radu

ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Inproceedings

In: ICLR 2023, 2023.

Links | BibTeX

2391.

Liu, Yukun; Li, Ta; Zhang, Pengyuan; Yan, Yonghong

LWMD: A Comprehensive Compression Platform for End-to-End Automatic Speech Recognition Models Journal Article

In: Applied Sciences, vol. 13, no. 3, 2023, ISSN: 2076-3417.

Abstract | Links | BibTeX

2390.

Son, David; Putter, Floran; Vogel, Sebastian; Corporaal, Henk

BOMP-NAS: Bayesian Optimization Mixed Precision NAS Technical Report

2023.

Links | BibTeX

2389.

Wang, Yawen; Zhang, Shihua

Prediction of Tumor Lymph Node Metastasis Using Wasserstein Distance-Based Generative Adversarial Networks Combing with Neural Architecture Search for Predicting Journal Article

In: Mathematics, vol. 11, no. 3, 2023, ISSN: 2227-7390.

Abstract | Links | BibTeX

2388.

Vidnerová, Petra; Kalina, Jan

Multi-objective Bayesian Optimization for Neural Architecture Search Inproceedings

In: Rutkowski, Leszek; Scherer, Rafał; Korytkowski, Marcin; Pedrycz, Witold; Tadeusiewicz, Ryszard; Zurada, Jacek M. (Ed.): Ärtificial Intelligence and Soft Computing", pp. 144–153, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-23492-7.

Abstract | Links | BibTeX

2387.

Huang, Lan; Sun, Shiqi; Zeng, Jia; Wang, Wencong; Pang, Wei; Wang, Kangping

U-DARTS: Uniform-space differentiable architecture search Journal Article

In: Information Sciences, vol. 628, pp. 339-349, 2023, ISSN: 0020-0255.

Abstract | Links | BibTeX

2386.

Ji, Zhanghexuan; Guo, Dazhou; Wang, Puyang; Yan, Ke; Lu, Le; Xu, Minfeng; Zhou, Jingren; Wang, Qifeng; Ge, Jia; Gao, Mingchen; Ye, Xianghua; Jin, Dakai

Continual Segment: Towards a Single, Unified and Accessible Continual Segmentation Model of 143 Whole-body Organs in CT Scans Technical Report

2023.

Links | BibTeX

2385.

Kang, Jeon-Seong; Kang, JinKyu; Kim, Jung-Jun; Jeon, Kwang-Woo; Chung, Hyun-Joon; Park, Byung-Hoon

Neural Architecture Search Survey: A Computer Vision Perspective Journal Article

In: Sensors, vol. 23, no. 3, 2023, ISSN: 1424-8220.

Abstract | Links | BibTeX

2384.

Rampavan, Medipelly; Ijjina, Earnest Paul

Genetic brake-net: Deep learning based brake light detection for collision avoidance using genetic algorithm Journal Article

In: Knowledge-Based Systems, pp. 110338, 2023, ISSN: 0950-7051.

Abstract | Links | BibTeX

2383.

Sarti, Simone; Lomurno, Eugenio; Falanti, Andrea; Matteucci, Matteo

Enhancing Once-For-All: A Study on Parallel Blocks, Skip Connections and Early Exits Technical Report

2023.

Links | BibTeX

2382.

Kulbach, Cedric Peter Charles

Adaptive Automated Machine Learning PhD Thesis

Karlsruher Institut für Technologie (KIT), 2023.

Links | BibTeX

2381.

Wang, Chao; Jiao, Licheng; Zhao, Jiaxuan; Li, Lingling; Liu, Xu; Liu, Fang; Yang, Shuyuan

Bi-level Multi-objective Evolutionary Learning: A Case Study on Multi-task Graph Neural Topology Search Technical Report

2023.

Links | BibTeX

2380.

Gao, Yang; Zhang, Peng; Zhou, Chuan; Yang, Hong; Li, Zhao; Hu, Yue; Yu, Philip S.

HGNAS++: Efficient Architecture Search for Heterogeneous Graph Neural Networks Journal Article

In: IEEE Transactions on Knowledge and Data Engineering, pp. 1-14, 2023.

Links | BibTeX

2379.

Zhou, Yuan; Hao, Jieke; Huo, Shuwei; Wang, Boyu; Ge, Leijiao; Kung, Sun-Yuan

Automatic Metric Search for Few-Shot Learning Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-12, 2023.

Links | BibTeX

2378.

Äkiva-Hochman, Ruth; Finder, Shahaf E.; Turek, Javier S.; Treister, Eran"

Searching for N:M Fine-grained Sparsity of Weights and Activations in Neural Networks Inproceedings

In: Karlinsky, Leonid; Michaeli, Tomer; Nishino, Ko (Ed.): Computer Vision -- ECCV 2022 Workshops, pp. 130–143, Springer Nature Switzerland, Cham, 2023, ISBN: 978-3-031-25082-8.

Abstract | BibTeX

2377.

Ünal, Hamit Taner; Başçiftçi, Fatih

Neural Logic Circuits: An evolutionary neural architecture that can learn and generalize Journal Article

In: Knowledge-Based Systems, vol. 265, pp. 110379, 2023, ISSN: 0950-7051.

Abstract | Links | BibTeX

2376.

Jin, Guangyin; Sha, Hengyu; Xi, Zhexu; Huang, Jincai

Urban hotspot forecasting via automated spatio-temporal information fusion Journal Article

In: Applied Soft Computing, vol. 136, pp. 110087, 2023, ISSN: 1568-4946.

Abstract | Links | BibTeX

2375.

Huang, Mingqiang; Liu, Yucen; Huang, Sixiao; Li, Kai; Wu, Qiuping; Yu, Hao

Multi-Bit-Width CNN Accelerator with Systolic-in-Systolic Dataflow and Single DSP Multiple Multiplication Scheme Inproceedings

In: Proceedings of the 2023 ACM/SIGDA International Symposium on Field Programmable Gate Arrays, pp. 229, Association for Computing Machinery, Monterey, CA, USA, 2023, ISBN: 9781450394178.

Abstract | Links | BibTeX

2374.

Wang, Xueying; Li, Guangli; Ma, Xiu; Feng, Xiaobing

Facilitating hardware-aware neural architecture search with learning-based predictive models Journal Article

In: Journal of Systems Architecture, vol. 137, pp. 102838, 2023, ISSN: 1383-7621.

Abstract | Links | BibTeX

2373.

Chatzianastasis, Michail; Ilias, Loukas; Askounis, Dimitris; Vazirgiannis, Michalis

Neural Architecture Search with Multimodal Fusion Methods for Diagnosing Dementia Technical Report

2023.

Links | BibTeX

2372.

Zhu, Xunyu; Li, Jian; Liu, Yong; Wang, Weiping

Improving Differentiable Architecture Search via Self-Distillation Technical Report

2023.

Links | BibTeX

2371.

Wang, Zhe; Yang, Fangfang; Xu, Qiang; Wang, Yongjian; Yan, Hong; Xie, Min

Capacity estimation of lithium-ion batteries based on data aggregation and feature fusion via graph neural network Journal Article

In: Applied Energy, vol. 336, pp. 120808, 2023, ISSN: 0306-2619.

Abstract | Links | BibTeX

2370.

Ismail, Walaa N.; Alsalamah, Hessah A.; Hassan, Mohammad Mehedi; Mohamed, Ebtesam

AUTO-HAR: An adaptive human activity recognition framework using an automated CNN architecture design Journal Article

In: Heliyon, vol. 9, no. 2, pp. e13636, 2023, ISSN: 2405-8440.

Abstract | Links | BibTeX

2369.

Gillard, Ryan; Jonany, Stephen; Miao, Yingjie; Munn, Michael; Souza, Connal; Dungay, Jonathan; Liang, Chen; So, David R.; Le, Quoc V.; Real, Esteban

Unified Functional Hashing in Automatic Machine Learning Technical Report

2023.

Links | BibTeX

2368.

Romero, David W.; Zeghidour, Neil

DNArch: Learning Convolutional Neural Architectures by Backpropagation Technical Report

2023.

Links | BibTeX

2367.

Zhang, Jinxia; Chen, Xinyi; Wei, Haikun; Zhang, Kanjian

A lightweight network for photovoltaic cell defect detection in electroluminescence images based on neural architecture search and knowledge distillation Technical Report

2023.

Links | BibTeX

2366.

Yuan, Gonglin; Wang, Bin; Xue, Bing; Zhang, Mengjie

Particle Swarm Optimization for Efficiently Evolving Deep Convolutional Neural Networks Using an Autoencoder-based Encoding Strategy Journal Article

In: IEEE Transactions on Evolutionary Computation, pp. 1-1, 2023.

Links | BibTeX

2365.

Bhattacharjee, Abhiroop; Moitra, Abhishek; Panda, Priyadarshini

XploreNAS: Explore Adversarially Robust & Hardware-efficient Neural Architectures for Non-ideal Xbars Technical Report

2023.

Links | BibTeX

2464 entries « 2 of 50 »