AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3369 entries « 2 of 68 »

2024

3319.

Liu, Shiya; Yi, Yang

Unleashing Energy-Efficiency: Neural Architecture Search without Training for Spiking Neural Networks on Loihi Chip Proceedings Article

In: 2024 25th International Symposium on Quality Electronic Design (ISQED), pp. 1-7, 2024.

Links | BibTeX

3318.

Liu, Siqin; Karanth, Avinash

SCORCH: Neural Architecture Search and Hardware Accelerator Co-design with Reinforcement Learning Proceedings Article

In: 2024 25th International Symposium on Quality Electronic Design (ISQED), pp. 1-8, 2024.

Links | BibTeX

3317.

Sukthanker, Rhea Sanjay; Zela, Arber; Staffler, Benedikt; Franke, Jorg K. H.; Hutter, Frank

HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models Technical Report

2024.

Links | BibTeX

3316.

Li, Yangyang; Liu, Guanlong; Zhao, Peixiang; Shang, Ronghua; Jiao, Licheng

Balanced quantum neural architecture search Journal Article

In: Neurocomputing, vol. 594, pp. 127860, 2024, ISSN: 0925-2312.

Abstract | Links | BibTeX

3315.

Xie, Wenyi; Yang, Haonan; Shi, Linjun; Liu, Zhigang

MTA-Net: A One-Stage Detector Based on a Multiscale Task-Aligned Network for Catenary Support Components Journal Article

In: IEEE Transactions on Instrumentation and Measurement, vol. 73, pp. 1-13, 2024.

Links | BibTeX

3314.

Li, Qingqing; Luo, Zhirui; Qi, Ruobin; Zheng, Jun

Automatic Searching of Lightweight and High-Performing CNN Architectures for EEG-Based Driving Fatigue Detection Journal Article

In: IEEE Transactions on Instrumentation and Measurement, vol. 73, pp. 1-11, 2024.

Links | BibTeX

3313.

Diaz, Edicson Santiago Bonilla; Naredo, Enrique; Díaz, Nicolas Francisco Mateo; Dias, Douglas Mota; Diaz, Maria Alejandra Bonilla; Harnett, Susan; Ryan, Conor

Neural architecture search for bearing fault classification Journal Article

In: 2024.

Links | BibTeX

3312.

Ragusa, Edoardo; Zonzini, Federica; Gastaldo, Paolo; Marchi, Luca De

Combining Compressed Sensing and Neural Architecture Search for Sensor-Near Vibration Diagnostics Journal Article

In: IEEE Transactions on Industrial Informatics, pp. 1-11, 2024.

Links | BibTeX

3311.

Coalson, Zachary; Wang, Huazheng; Wu, Qingyun; Hong, Sanghyun

Hard Work Does Not Always Pay Off: Poisoning Attacks on Neural Architecture Search Technical Report

2024.

Links | BibTeX

3310.

Soin, Hartej; Tripura, Tapas; Chakraborty, Souvik

Generative flow induced neural architecture search: Towards discovering optimal architecture in wavelet neural operator Technical Report

2024.

Links | BibTeX

3309.

Tan, Menghao; Gao, Weifeng; Li, Hong; Xie, Jin; Gong, Maoguo

Universal Binary Neural Networks Design by Improved Differentiable Neural Architecture Search Journal Article

In: IEEE Transactions on Circuits and Systems for Video Technology, pp. 1-1, 2024.

Links | BibTeX

3308.

Xu, Ke; Shao, Xiangyang; Tian, Ye; Yang, Shangshang; Zhang, Xingyi

AutoMPQ: Automatic Mixed-Precision Neural Network Search via Few-Shot Quantization Adapter Journal Article

In: IEEE Transactions on Emerging Topics in Computational Intelligence, pp. 1-13, 2024.

Links | BibTeX

3307.

Pan, Yang

DEEP LEARNING APPLICATIONS ON IONOSPHERIC STUDIES PhD Thesis

2024.

Links | BibTeX

3306.

Ou, Yuwei; Feng, Yuqi; Sun, Yanan

Towards Accurate and Robust Architectures via Neural Architecture Search Technical Report

2024.

Links | BibTeX

3305.

Chen, Jiamin; Gao, Jianliang; Wu, Zhenpeng; Al-Sabri, Raeed; Oloulade, Babatounde Moctard

Decoupled differentiable graph neural architecture search Journal Article

In: Information Sciences, vol. 673, pp. 120700, 2024, ISSN: 0020-0255.

Abstract | Links | BibTeX

3304.

Li, Zhengang; Lu, Alec; Xie, Yanyue; Kong, Zhenglun; Sun, Mengshu; Tang, Hao; Xue, Zhong Jia; Dong, Peiyan; Ding, Caiwen; Wang, Yanzhi; Lin, Xue; Fang, Zhenman

Quasar-ViT: Hardware-Oriented Quantization-Aware Architecture Search for Vision Transformers Proceedings Article

In: Proceedings of the 38th ACM International Conference on Supercomputing, pp. 324–337, Association for Computing Machinery, <conf-loc>, <city>Kyoto</city>, <country>Japan</country>, </conf-loc>, 2024, ISBN: 9798400706103.

Abstract | Links | BibTeX

3303.

Benedykciuk, Emil; Denkowski, Marcin; Wójcik, Grzegorz

Implantable Adaptive Cells: differentiable architecture search to improve the performance of any trained U-shaped network Technical Report

2024.

Links | BibTeX

3302.

(Ed.)

GRASP-GCN: Graph-Shape Prioritization for Neural Architecture Search under Distribution Shifts Collection

2024.

Links | BibTeX

3301.

Xie, Lunchen; Lomurno, Eugenio; Gambella, Matteo; Ardagna, Danilo; Roveri, Manuel; Matteucci, Matteo; Shi, Qingjiang

A Lightweight Neural Architecture Search Model for Medical Image Classification Technical Report

2024.

Links | BibTeX

3300.

Klein, Aaron; Golebiowski, Jacek; Ma, Xingchen; Perrone, Valerio; Archambeau, Cedric

Structural Pruning of Pre-trained Language Models via Neural Architecture Search Technical Report

2024.

Links | BibTeX

3299.

Wei, Hang; Wang, Zulin; Hua, Gengxin; Ni, Yuanhan

A Zero-Shot NAS Method for SAR Ship Detection Under Polynomial Search Complexity Journal Article

In: IEEE Signal Processing Letters, vol. 31, pp. 1329-1333, 2024.

Links | BibTeX

3298.

Sun, Yu; Su, Lei; Gu, Jiefei; Zhao, Xinwei; Li, Ke; Pecht, Michael

Search for a Dual-Convergence Sparse Feature Extractor With Visualization Vibration Signals Architecture Feature for Flip-Chip Defect Detection Journal Article

In: IEEE Transactions on Industrial Informatics, pp. 1-11, 2024.

Links | BibTeX

3297.

Zhang, Xixi; Wang, Qin; Qin, Maoyang; Wang, Yu; Ohtsuki, Tomoaki; Adebisi, Bamidele; Sari, Hikmet; Gui, Guan

Enhanced Few-Shot Malware Traffic Classification via Integrating Knowledge Transfer With Neural Architecture Search Journal Article

In: IEEE Transactions on Information Forensics and Security, vol. 19, pp. 5245-5256, 2024.

Links | BibTeX

3296.

Peng, Sitian; Jiang, Jingwen; Ou, Qiaofeng; Xiong, Bangshu; Liu, Chang; Rao, Zhibo

DARTS-based morphological neural network design and application in bearing fault diagnosis Journal Article

In: Measurement, vol. 234, pp. 114805, 2024, ISSN: 0263-2241.

Abstract | Links | BibTeX

3295.

Chen, Yaofo; Guo, Yong; Liao, Daihai; Lv, Fanbing; Song, Hengjie; Kwok, James Tin-Yau; Tan, Mingkui

Automated Dominative Subspace Mining for Efficient Neural Architecture Search Journal Article

In: IEEE Transactions on Circuits and Systems for Video Technology, pp. 1-1, 2024.

Links | BibTeX

3294.

Xu, Xiaozhou; Chen, Jun; Li, Zhishan; Su, Hongye; Xie, Lei

Towards efficient filter pruning via adaptive automatic structure search Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 133, pp. 108398, 2024, ISSN: 0952-1976.

Abstract | Links | BibTeX

3293.

Davy, Nandito; Waheed, Umair Bin; Koeshidayatullah, Ardiansyah; El-Husseiny, Ammar; Ayranci, Korhan; Harris, Nicholas B.; Dong, Tian

Leveraging automated deep learning (AutoDL) in geosciences Journal Article

In: Computers & Geosciences, vol. 188, pp. 105600, 2024, ISSN: 0098-3004.

Abstract | Links | BibTeX

3292.

Zhou, Xiaomeng; Xuanyuan, Shutian; Ye, Yang; Sun, Ying; Du, Haowen; Qi, Luguang; Li, Chang; Xie, Chuang

Predicting Bulk Density for Agglomerated Raspberry Ketone via Integrating Morphological and Size Metrics Using Artificial Neural Networks Journal Article

In: Processes, vol. 12, no. 5, 2024, ISSN: 2227-9717.

Abstract | Links | BibTeX

3291.

Zhang, Tunhou; Li, Shiyu; Cheng, Hsin-Pai; Yan, Feng; Li, Hai; Chen, Yiran

CSCO: Connectivity Search of Convolutional Operators Technical Report

2024.

Links | BibTeX

3290.

Xue, Yu; Zha, Jiajie; Pelusi, Danilo; Chen, Peng; Luo, Tao; Zhen, Liangli; Wang, Yan; Wahib, Mohamed

Neural Architecture Search With Progressive Evaluation and Sub-Population Preservation Journal Article

In: IEEE Transactions on Evolutionary Computation, pp. 1-1, 2024.

Links | BibTeX

3289.

Zhao, Yifan; Liang, Zhenyu; Lu, Zhichao; Cheng, Ran

A Multi-objective Optimization Benchmark Test Suite for Real-time Semantic Segmentation Technical Report

2024.

Links | BibTeX

3288.

Kadlecová, Gabriela; Lukasik, Jovita; Pilát, Martin; Vidnerová, Petra; Safari, Mahmoud; Neruda, Roman; Hutter, Frank

Surprisingly Strong Performance Prediction with Neural Graph Features Technical Report

2024.

Links | BibTeX

3287.

Fan, Yibing; Zhang, Lanyong; Li, Peng

A Lightweight Model of Underwater Object Detection Based on YOLOv8n for an Edge Computing Platform Journal Article

In: Journal of Marine Science and Engineering, vol. 12, no. 5, 2024, ISSN: 2077-1312.

Abstract | Links | BibTeX

3286.

Jaiswal, Dibyanshu; Mukhopadhyay, Shalini; Sharma, Varsha

TinyStressNet: On-device Stress Assessment with Wearable Sensors on Edge Devices Proceedings Article

In: 2024 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), pp. 166-171, 2024.

Links | BibTeX

3285.

Dey, Swarnava

Keynote: AutoML for TinyML Proceedings Article

In: 2024 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), pp. 159-159, 2024.

Links | BibTeX

3284.

Lee, Jiho; Kim, Eunwoo

Mitigating Search Interference With Task-Aware Nested Search Journal Article

In: IEEE Trans. Image Process., vol. 33, pp. 3102–3114, 2024.

Links | BibTeX

3283.

Terin, Rodrigo Carmo; Arenas, Zochil González; Santana, Roberto

Identifying phase transitions in physical systems with neural networks: a neural architecture search perspective Technical Report

2024.

Links | BibTeX

3282.

Khan, Salabat; Nosheen, Fariha; Naqvi, Syed Shehryar Ali; Jamil, Harun; Faseeh, Muhammad; Khan, Murad-Ali; Kim, Dohyeun

Bilevel Hyperparameter Optimization and Neural Architecture Search for Enhanced Breast Cancer Detection in Smart Hospitals Interconnected With Decentralized Federated Learning Environment Journal Article

In: IEEE Access, vol. 12, pp. 63618–63628, 2024.

Links | BibTeX

3281.

Lu, Aojun; Feng, Tao; Yuan, Hangjie; Song, Xiaotian; Sun, Yanan

Revisiting Neural Networks for Continual Learning: An Architectural Perspective Technical Report

2024.

Links | BibTeX

3280.

Broni-Bediako, Clifford; Xia, Junshi; Yokoya, Naoto

Unsupervised Domain Adaptation Architecture Search with Self-Training for Land Cover Mapping Technical Report

2024.

BibTeX

3279.

Wang, Yanghu; Zhou, Zheng; Yang, Laihao; Gao, Robert X.; Yan, Ruqiang

Wavelet-driven differentiable architecture search for planetary gear fault diagnosis Journal Article

In: Journal of Manufacturing Systems, vol. 74, pp. 587-593, 2024, ISSN: 0278-6125.

Abstract | Links | BibTeX

3278.

Terin, Rodrigo Carmo; Arenas, Zochil González; Santana, Roberto

Identifying phase transitions in physical systems with neural networks: a neural architecture search perspective Technical Report

2024.

Links | BibTeX

3277.

Sinha, Nilotpal; Rostami, Peyman; Shabayek, Abd El Rahman; Kacem, Anis; Aouada, Djamila

Multi-Objective Hardware Aware Neural Architecture Search using Hardware Cost Diversity Technical Report

2024.

Links | BibTeX

3276.

Phan, Quan Minh; Luong, Ngoc Hoang

Parameter-less Pareto local search for multi-objective neural architecture search with the Interleaved Multi-start Scheme Journal Article

In: Swarm and Evolutionary Computation, vol. 87, pp. 101573, 2024, ISSN: 2210-6502.

Abstract | Links | BibTeX

3275.

Neumeyer, Simon; Stier, Julian; Granitzer, Michael

Efficient NAS with FaDE on Hierarchical Spaces Proceedings Article

In: Miliou, Ioanna; Piatkowski, Nico; Papapetrou, Panagiotis (Ed.): Advances in Intelligent Data Analysis XXII, pp. 158–170, Springer Nature Switzerland, Cham, 2024, ISBN: 978-3-031-58553-1.

Abstract | Links | BibTeX

3274.

Lou, Wenqi; Gong, Lei; Wang, Chao; Qian, Jiaming; Wang, Xuan; Li, Changlong; Zhou, Xuehai

Unleashing Network/Accelerator Co-Exploration Potential on FPGAs: A Deeper Joint Search Journal Article

In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2024.

Links | BibTeX

3273.

Muñoz, J. Pablo; Yuan, Jinjie; Jain, Nilesh

Shears: Unstructured Sparsity with Neural Low-rank Adapter Search Technical Report

2024.

Links | BibTeX

3272.

Liu, Yue; Yu, Ziyi; Liu, Zitu; Tian, Wenjie

Efficient Neural Architecture Design via Capturing Architecture-Performance Joint Distribution Proceedings Article

In: Dasgupta, Sanjoy; Mandt, Stephan; Li, Yingzhen (Ed.): International Conference on Artificial Intelligence and Statistics, 2-4 May 2024, Palau de Congressos, Valencia, Spain, pp. 1738–1746, PMLR, 2024.

Links | BibTeX

3271.

Xiang, Xunzhi; Jing, Kun; Xu, Jungang

A Neural Architecture Predictor based on GNN-Enhanced Transformer Proceedings Article

In: Dasgupta, Sanjoy; Mandt, Stephan; Li, Yingzhen (Ed.): International Conference on Artificial Intelligence and Statistics, 2-4 May 2024, Palau de Congressos, Valencia, Spain, pp. 1729–1737, PMLR, 2024.

Links | BibTeX

3270.

Qin, Danfeng; Leichner, Chas; Delakis, Manolis; Fornoni, Marco; Luo, Shixin; Yang, Fan; Wang, Weijun; Banbury, Colby; Ye, Chengxi; Akin, Berkin; Aggarwal, Vaibhav; Zhu, Tenghui; Moro, Daniele; Howard, Andrew

MobileNetV4 – Universal Models for the Mobile Ecosystem Technical Report

2024.

Links | BibTeX

3369 entries « 2 of 68 »