AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4236 entries « 49 of 85 »

2022

1836.

Kim, Heewon; Hong, Seokil; Han, Bohyung; Myeong, Heesoo; Lee, Kyoung Mu

Fine-grained neural architecture search for image super-resolution Journal Article

In: Journal of Visual Communication and Image Representation, vol. 89, pp. 103654, 2022, ISSN: 1047-3203.

Abstract | Links | BibTeX

1835.

Duggal, Rahul; Peng, Shengyun; Zhou, Hao; Chau, Duen Horng

IMB-NAS: Neural Architecture Search for Imbalanced Datasets Technical Report

2022.

Links | BibTeX

1834.

Vu, Thanh; Zhou, Yanqi; Wen, Chunfeng; Li, Yueqi; Frahm, Jan-Michael

Toward Edge-Efficient Dense Predictions with Synergistic Multi-Task Neural Architecture Search Technical Report

2022.

Links | BibTeX

1833.

Bao, Zhenshan; Zhao, Qian; Zhang, Wenbo; Ding, Yilong

MOD-NAS: Migration-Based Object Detection Neural Architecture Search Proceedings Article

In: 2022 5th International Conference on Pattern Recognition and Artificial Intelligence (PRAI), pp. 1097-1102, 2022.

Links | BibTeX

1832.

Zhang, Yu-Ming; Hsieh, Jun-Wei; Lee, Chun-Chieh; Fan, Kuo-Chin

Siamese-NAS: Using Trained Samples Efficiently to Find Lightweight Neural Architecture by Prior Knowledge Technical Report

2022.

Links | BibTeX

1831.

Brown, Jason Ross; Zhao, Yiren; Shumailov, Ilia; Mullins, Robert D.

DARTFormer: Finding The Best Type Of Attention Technical Report

2022.

Links | BibTeX

1830.

Wang, Yi-Chun; Hsieh, Jun-Wei; Chang, Ming-Ching

NAS-based Recursive Stage Partial Network (RSPNet) for Light-Weight Semantic Segmentation Technical Report

2022.

Links | BibTeX

1829.

Liu, Dingbang; Zhou, Haoxiang; Mao, Wei; Liu, Jun; Han, Yuliang; Man, Changhai; Wu, Qiuping; Guo, Zhiru; Huang, Mingqiang; Luo, Shaobo; Lv, Mingsong; Chen, Quan; Yu, Hao

An Energy-Efficient Mixed-Bit CNN Accelerator with Column Parallel Readout for ReRAM-based In-memory Computing Journal Article

In: IEEE Journal on Emerging and Selected Topics in Circuits and Systems, pp. 1-1, 2022.

Links | BibTeX

1828.

Dirks, Matthew C.; Poole, David L.

Automatic Neural Network Hyperparameter Optimization for Extrapolation: Lessons Learned from Visible and Near-Infrared Spectroscopy of Mango Fruit Technical Report

2022.

Links | BibTeX

1827.

Chitty-Venkata, Krishna Teja; Emani, Murali; Vishwanath, Venkatram; Somani, Arun K.

Neural Architecture Search for Transformers: A Survey Journal Article

In: IEEE Access, vol. 10, pp. 108374–108412, 2022.

Links | BibTeX

1826.

Wang, Zihan; Gupta, Akshat; Meng, Qi; Lan, Haifeng; Zhang, Xinrui; Guo, Kehao

MULTILINGUAL SPEECH EMOTION RECOGNITION WITH MULTI-GATING MECHANISM AND NEURAL ARCHITECTURE SEARCH Proceedings Article

In: SLT'22, 2022.

BibTeX

1825.

Li, Zhuojin; Paolieri, Marco; Golubchik, Leana

Inference Latency Prediction at the Edge Technical Report

2022.

Links | BibTeX

1824.

Zhou, Qin; Cao, Jiajia; Yin, Ling; Zhang, Fei; Li, Yun

INAS: Incremental Neural Architecture Search Proceedings Article

In: 2022 27th International Conference on Automation and Computing (ICAC), pp. 1-6, 2022.

Links | BibTeX

1823.

Zhang, Xinbang; Jin, Qizhao; Xiang, Shiming; Pan, Chunhong

MFNet: The Spatio-Temporal Network for Meteorological Forecasting With Architecture Search Journal Article

In: IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1-5, 2022.

Links | BibTeX

1822.

Kao, Sheng-Chun; Parashar, Angshuman; Tsai, Po-An; Krishna, Tushar

Demystifying Map Space Exploration for NPUs Technical Report

2022.

Links | BibTeX

1821.

Duan, Yiqun; Wang, Zhen; Li, Yi; Tang, Jianhang; Wang, Yu-Kai; Lin, Chin-Teng

Cross Task Neural Architecture Search for EEG Signal Classifications Technical Report

2022.

Links | BibTeX

1820.

Lv, Zeqiong; Qian, Chao; Yen, Gary G.; Sun, Yanan

Analysis of Expected Hitting Time for Designing Evolutionary Neural Architecture Search Algorithms Technical Report

2022.

Links | BibTeX

1819.

Marchisio, Alberto; Mrazek, Vojtech; Massa, Andrea; Bussolino, Beatrice; Martina, Maurizio; Shafique, Muhammad

RoHNAS: A Neural Architecture Search Framework With Conjoint Optimization for Adversarial Robustness and Hardware Efficiency of Convolutional and Capsule Networks Journal Article

In: IEEE Access, vol. 10, pp. 109043–109055, 2022.

Links | BibTeX

1818.

Zhou, Yuwei; Wang, Xin; Chen, Hong; Duan, Xuguang; Guan, Chaoyu; Zhu, Wenwu

Curriculum-NAS: Curriculum Weight-Sharing Neural Architecture Search Proceedings Article

In: Proceedings of the 30th ACM International Conference on Multimedia, pp. 6792–6801, Association for Computing Machinery, Lisboa, Portugal, 2022, ISBN: 9781450392037.

Abstract | Links | BibTeX

1817.

Bakhtiarifard, Pedram; Igel, Christian; Selvan, Raghavendra

Energy Consumption-Aware Tabular Benchmarks for Neural Architecture Search Technical Report

2022.

Links | BibTeX

1816.

Premchandar, Sumegha; Madireddy, Sandeep; Jantre, Sanket; Balaprakash, Prasanna

Unified Probabilistic Neural Architecture and Weight Ensembling Improves Model Robustness Technical Report

2022.

Links | BibTeX

1815.

Guo, Bicheng; Chen, Tao; He, Shibo; Liu, Haoyu; Xu, Lilin; Ye, Peng; Chen, Jiming

Generalized Global Ranking-Aware Neural Architecture Ranker for Efficient Image Classifier Search Proceedings Article

In: Proceedings of the 30th ACM International Conference on Multimedia, pp. 3730–3741, Association for Computing Machinery, Lisboa, Portugal, 2022, ISBN: 9781450392037.

Abstract | Links | BibTeX

1814.

Liu, Chenxi; Leng, Zhaoqi; Sun, Pei; Cheng, Shuyang; Qi, Charles R.; Zhou, Yin; Tan, Mingxing; Anguelov, Dragomir

LidarNAS: Unifying and Searching Neural Architectures for 3D Point Clouds Proceedings Article

In: Avidan, Shai; Brostow, Gabriel J.; Cissé, Moustapha; Farinella, Giovanni Maria; Hassner, Tal (Ed.): Computer Vision - ECCV 2022 - 17th European Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part XXI, pp. 158–175, Springer, 2022.

Links | BibTeX

1813.

Maile, Kaitlin; Wilson, Dennis G.; Forré, Patrick

Architectural Optimization over Subgroups for Equivariant Neural Networks Technical Report

2022.

Links | BibTeX

1812.

Lin, Haojia; Li, Lijiang; Zheng, Xiawu; Chao, Fei; Ji, Rongrong

Searching Lightweight Neural Network for Image Signal Processing Proceedings Article

In: Proceedings of the 30th ACM International Conference on Multimedia, pp. 2825–2833, Association for Computing Machinery, Lisboa, Portugal, 2022, ISBN: 9781450392037.

Abstract | Links | BibTeX

1811.

Hosseini, Ramtin; Xie, Pengtao

Image Understanding by Captioning with Differentiable Architecture Search Proceedings Article

In: Proceedings of the 30th ACM International Conference on Multimedia, pp. 4665–4673, Association for Computing Machinery, Lisboa, Portugal, 2022, ISBN: 9781450392037.

Abstract | Links | BibTeX

1810.

Wen, Long; Gao, Liang; Li, Xinyu; Li, Hui

A new genetic algorithm based evolutionary neural architecture search for image classification Journal Article

In: Swarm and Evolutionary Computation, vol. 75, pp. 101191, 2022, ISSN: 2210-6502.

Abstract | Links | BibTeX

1809.

Li, Yifan; Liu, Jing; Teng, Yingzhi

A decomposition-based memetic neural architecture search algorithm for univariate time series forecasting Journal Article

In: Applied Soft Computing, vol. 130, pp. 109714, 2022, ISSN: 1568-4946.

Abstract | Links | BibTeX

1808.

Yang, Fan; Li, Xin; Shen, Jianbing

Nested Architecture Search for Point Cloud Semantic Segmentation Journal Article

In: IEEE Transactions on Image Processing, pp. 1-1, 2022.

Links | BibTeX

1807.

Shu, Yao; Chen, Yizhou; Dai, Zhongxiang; Low, Bryan Kian Hsiang

Neural ensemble search via Bayesian sampling Proceedings Article

In: Cussens, James; Zhang, Kun (Ed.): Uncertainty in Artificial Intelligence, Proceedings of the Thirty-Eighth Conference on Uncertainty in Artificial Intelligence, UAI 2022, 1-5 August 2022, Eindhoven, The Netherlands, pp. 1803–1812, PMLR, 2022.

Links | BibTeX

1806.

Jawahar, Ganesh; Mukherjee, Subhabrata; Liu, Xiaodong; Kim, Young Jin; Abdul-Mageed, Muhammad; Lakshmanan, Laks V. S.; Awadallah, Ahmed Hassan; Bubeck, Sébastien; Gao, Jianfeng

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers Journal Article

In: CoRR, vol. abs/2210.07535, 2022.

Links | BibTeX

1805.

Chen, Hongjiang; Wang, Yang; Liu, Leibo; Wei, Shaojun; Yin, Shouyi

HQNAS: Auto CNN deployment framework for joint quantization and architecture search Journal Article

In: CoRR, vol. abs/2210.08485, 2022.

Links | BibTeX

1804.

Guo, Yong; Chen, Yaofo; Zheng, Yin; Chen, Qi; Zhao, Peilin; Chen, Jian; Huang, Junzhou; Tan, Mingkui

Pareto-aware Neural Architecture Generation for Diverse Computational Budgets Technical Report

2022.

Links | BibTeX

1803.

Chen, Hongjiang; Wang, Yang; Liu, Leibo; Wei, Shaojun; Yin, Shouyi

FAQS: Communication-efficient Federate DNN Architecture and Quantization Co-Search for personalized Hardware-aware Preferences Technical Report

2022.

Links | BibTeX

1802.

Li, Fuxian; Yan, Huan; Jin, Guangyin; Liu, Yue; Li, Yong; Jin, Depeng

Automated Spatio-Temporal Synchronous Modeling with Multiple Graphs for Traffic Prediction Technical Report

2022.

Links | BibTeX

1801.

Mao, Wei; Dai, Liuyao; Li, Kai; Cheng, Quan; Wang, Yuhang; Du, Laimin; Luo, Shaobo; Huang, Mingqiang; Yu, Hao

An Energy-Efficient Mixed-Bitwidth Systolic Accelerator for NAS-Optimized Deep Neural Networks Journal Article

In: IEEE Transactions on Very Large Scale Integration (VLSI) Systems, pp. 1-13, 2022.

Links | BibTeX

1800.

Movahedi, Sajad; Adabinejad, Melika; Imani, Ayyoob; Keshavarz, Arezou; Dehghani, Mostafa; Shakery, Azadeh; Araabi, Babak Nadjar

(Łambda)-DARTS: Mitigating Performance Collapse by Harmonizing Operation Selection among Cells Technical Report

2022.

Links | BibTeX

1799.

Hoang, Duc; Wang, Haotao; Zhao, Handong; Rossi, Ryan; Kim, Sungchul; Mahadik, Kanak; Wang, Zhangyang

AutoMARS: Searching to Compress Multi-Modality Recommendation Systems Proceedings Article

In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management, pp. 727–736, Association for Computing Machinery, Atlanta, GA, USA, 2022, ISBN: 9781450392365.

Abstract | Links | BibTeX

1798.

Hoang, Duc; Wang, Haotao; Zhao, Handong; Rossi, Ryan; Kim, Sungchul; Mahadik, Kanak; Wang, Zhangyang

AutoMARS: Searching to Compress Multi-Modality Recommendation Systems Proceedings Article

In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management, pp. 727–736, Association for Computing Machinery, Atlanta, GA, USA, 2022, ISBN: 9781450392365.

Abstract | Links | BibTeX

1797.

Wang, Zhaozhi; Su, Kefan; Zhang, Jian; Jia, Huizhu; Ye, Qixiang; Xie, Xiaodong; Lu, Zongqing

Multi-Agent Automated Machine Learning Technical Report

2022.

Links | BibTeX

1796.

Sun, Jia; Li, Yanfeng; Chen, Houjin; Peng, Yahui

A Person Re-Identification Baseline Based on Attention Block Neural Architecture Search Proceedings Article

In: 2022 IEEE International Conference on Image Processing (ICIP), pp. 841-845, 2022.

Links | BibTeX

1795.

Chau, Thomas Chun-Pong; Dudziak, Lukasz; Wen, Hongkai; Lane, Nicholas Donald; Abdelfattah, Mohamed S.

BLOX: Macro Neural Architecture Search Benchmark and Algorithms Technical Report

2022.

Links | BibTeX

1794.

Cai, He; Zhang, Zhaokai; Feng, Tianpeng; Guo, Yandong

DARTS-PD: Differentiable Architecture Search with Path-Wise Weight Sharing Derivation Proceedings Article

In: 2022 IEEE International Conference on Image Processing (ICIP), pp. 1256-1260, 2022.

Links | BibTeX

1793.

Sukthanker, Rhea; Dooley, Samuel; Dickerson, John P.; White, Colin; Hutter, Frank; Goldblum, Micah

On the Importance of Architectures and Hyperparameters for Fairness in Face Recognition Technical Report

2022.

Links | BibTeX

1792.

Li, Yuhong; Li, Jiajie; Han, Cong; Li, Pan; Xiong, Jinjun; Chen, Deming

Extensible Proxy for Efficient NAS Technical Report

2022.

Links | BibTeX

1791.

Shi, Huihong; You, Haoran; Zhao, Yang; Wang, Zhongfeng; Lin, Yingyan

NASA: Neural Architecture Search and Acceleration for Hardware Inspired Hybrid Networks Technical Report

2022.

Links | BibTeX

1790.

Bober-Irizar, Mikel; Shumailov, Ilia; Zhao, Yiren; Mullins, Robert; Papernot, Nicolas

Architectural Backdoors in Neural Networks Technical Report

2022.

Links | BibTeX

1789.

Koh, Edwin J. Y.; Amini, Eiman; Gaur, Shruti; Maquieira, Miguel Becerra; Heck, Christian Jara; McLachlan, Geoffrey J.; Beaton, Nick

An Automated Machine learning (AutoML) approach to regression models in minerals processing with case studies of developing industrial comminution and flotation models Journal Article

In: Minerals Engineering, vol. 189, pp. 107886, 2022, ISSN: 0892-6875.

Abstract | Links | BibTeX

1788.

Bitzer, Matthias; Meister, Mona; Zimmer, Christoph

Structural Kernel Search via Bayesian Optimization and Symbolical Optimal Transport Technical Report

2022.

Links | BibTeX

1787.

Pujari, Keerthi Nagasree; Miriyala, Srinivas Soumitri; Mittal, Prateek; Mitra, Kishalay

Better Wind forecasting using Evolutionary Neural Architecture Search driven Green Deep Learning Journal Article

In: Expert Systems with Applications, pp. 119063, 2022, ISSN: 0957-4174.

Abstract | Links | BibTeX

4236 entries « 49 of 85 »