AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3651 entries « 44 of 74 »

2021

1501.

Luo, Xiangzhong; Liu, Di; Huai, Shuo; Liu, Weichen

HSCoNAS: Hardware-Software Co-Design of Efficient DNNs via Neural Architecture Search Technical Report

2021.

Links | BibTeX

1500.

Wang, Ruochen; Cheng, Minhao; Chen, Xiangning; Tang, Xiaocheng; Hsieh, Cho-Jui

Rethinking Architecture Selection in Differentiable NAS Proceedings Article

In: International Conference on Learning Representations, 2021.

Links | BibTeX

1499.

-, Sian; -, Wei

Searching by Generating: Flexible and Efficient One-Shot NAS with Architecture Generator Technical Report

2021.

Links | BibTeX

1498.

Lakhmiri, Dounia; é, S

Use of static surrogates in hyperparameter optimization Technical Report

2021.

Links | BibTeX

1497.

Inkawhich, Matthew; Inkawhich, Nathan; Davis, Eric; Li, Hai; Chen, Yiran

The Untapped Potential of Off-the-Shelf Convolutional Neural Networks Technical Report

2021.

Links | BibTeX

1496.

Chen, Zhiqiang; Xu, Ting-Bing; Liao, Weijian; Li, Zhengcheng; Li, Jinpeng; Liu, Cheng-Lin; He, Huiguang

SNAP: Shaping neural architectures progressively via information density criterion Journal Article

In: Pattern Recognition, vol. 116, pp. 107923, 2021, ISSN: 0031-3203.

Abstract | Links | BibTeX

1495.

Li, Chaojian; Yu, Zhongzhi; Fu, Yonggan; Zhang, Yongan; Zhao, Yang; You, Haoran; Yu, Qixuan; Wang, Yue; Lin, Yingyan

HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark Proceedings Article

In: ICLR 2021, 2021.

Links | BibTeX

1494.

Pyeon, Myeongjang; Moon, Jihwan; Hahn, Taeyoung; Kim, Gunhee

SEDONA: Search for Decoupled Neural Networks toward Greedy Block-wise Learning Proceedings Article

In: International Conference on Learning Representations, 2021.

Links | BibTeX

1493.

Zhou, Allan; Knowles, Tom; Finn, Chelsea

Meta-learning Symmetries by Reparameterization Proceedings Article

In: International Conference on Learning Representations, 2021.

Links | BibTeX

1492.

Mehrotra, Abhinav; Ramos, Alberto Gil C P; Bhattacharya, Sourav; Ł,; Vipperla, Ravichander; Chau, Thomas; Abdelfattah, Mohamed S; Ishtiaq, Samin; Lane, Nicholas Donald

NAS-Bench-ASR: Reproducible Neural Architecture Search for Speech Recognition Proceedings Article

In: International Conference on Learning Representations, 2021.

Links | BibTeX

1491.

Zhou, Daquan; Jin, Xiaojie; Lian, Xiaochen; Yang, Linjie; Xue, Yujing; Hou, Qibin; Feng, Jiashi

AutoSpace: Neural Architecture Search with Less Human Interference Technical Report

2021.

Links | BibTeX

1490.

Li, Changlin; Tang, Tao; Wang, Guangrun; Peng, Jiefeng; Wang, Bing; Liang, Xiaodan; Chang, Xiaojun

BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Technical Report

2021.

Links | BibTeX

1489.

Abed, H; Gyires-Tóth, B

Efficient Neural Architecture Search for Long Short-Term Memory Networks Proceedings Article

In: 2021 IEEE 19th World Symposium on Applied Machine Intelligence and Informatics (SAMI), pp. 000287-000292, 2021.

Links | BibTeX

1488.

Ai, Dige; Zhang, Hong

GNAS: A Generalized Neural Network Architecture Search Framework Technical Report

2021.

Links | BibTeX

1487.

Zhang, Haichao; Hao, Kuangrong; Gao, Lei; -, Xue; Wei, Bing

Enhanced Gradient for Differentiable Architecture Search Technical Report

2021.

Links | BibTeX

1486.

Su, Xiu; Huang, Tao; Li, Yanxi; You, Shan; Wang, Fei; Qian, Chen; Zhang, Changshui; Xu, Chang

Prioritized Architecture Sampling with Monto-Carlo Tree Search Technical Report

2021.

Links | BibTeX

1485.

Wang, Hongbo; Pan, Xingyu; Fan, Lingyan; Zhao, Shuofeng

Steganalysis of convolutional neural network based on neural architecture search Journal Article

In: Multimedia Systems, 2021.

Links | BibTeX

1484.

Lu, Zexin; Xia, Wenjun; Huang, Yongqiang; Shan, Hongming; Chen, Hu; Zhou, Jiliu; Zhang, Yi

MANAS: Multi-Scale and Multi-Level Neural Architecture Search for Low-Dose CT Denoising Journal Article

In: CoRR, vol. abs/2103.12995, 2021.

Links | BibTeX

1483.

"Yang Zhao" "Hai Min" "Yan-Xiang Chen Wei Jia" "Wei Xia",

2D and 3D Palmprint and Palm Vein Recognition Based on Neural Architecture Search Journal Article

In: International Journal of Automation and Computing, no. IJAC-2021-01-01, pp. 1, 2021, ISSN: 1476-8186.

Links | BibTeX

1482.

Lin, Yunfeng; Li, Guilin; Zhang, Xing; Zhang, Weinan; Chen, BO; Tang, Ruiming; Li, Zhenguo; Feng, Jiashi; Yu, YOng

ModularNAS: Towards Modularized and Reusable Neural Architecture Search Proceedings Article

In: Proceedings of Machine Learning and Systems 3 pre-proceedings (MLSys 2021), 2021.

Links | BibTeX

1481.

Wang, Rui; Wei, Zhihua; Ji, Shouling; Hong, Zhen

EfficientTDNN: Efficient Architecture Search for Speaker Recognition in the Wild Technical Report

2021.

Links | BibTeX

1480.

Ottelander, Tom Den; Dushatskiy, Arkadiy; Virgolin, Marco; Bosman, Peter A N

Local Search is a Remarkably Strong Baseline for Neural Architecture Search Proceedings Article

In: Ishibuchi, Hisao; Zhang, Qingfu; Cheng, Ran; Li, Ke; Li, Hui; Wang, Handing; Zhou, Aimin (Ed.): Evolutionary Multi-Criterion Optimization - 11th International Conference, EMO 2021, Shenzhen, China, March 28-31, 2021, Proceedings, pp. 465–479, Springer, 2021.

Links | BibTeX

1479.

Ding, Mingyu; Huo, Yuqi; Lu, Haoyu; Yang, Linjie; Wang, Zhe; Lu, Zhiwu; Wang, Jingdong; Luo, Ping

Learning Versatile Neural Architectures by Propagating Network Codes Technical Report

2021.

Links | BibTeX

1478.

Lankford, Séamus

Open-Source Neural Architecture Search with Ensemble and Pre-trained Networks Journal Article

In: International Journal of Modeling and Optimization, vol. 11, no. 2, pp. 33-41, 2021.

Links | BibTeX

1477.

Li, Yanxi; Wen, Zean; Yunhe Wang,; Xu, Chang

One-shot Graph Neural Architecture Search with Dynamic Search Space Proceedings Article

In: AAAI 2021, 2021.

Links | BibTeX

1476.

Cai, Shaofei; Li, Liang; Deng, Jincan; Zhang, Beichen; Zha, Zheng-Jun; Su, Li; Huang, Qingming

Rethinking Graph Neural Network Search from Message-passing Technical Report

2021.

Links | BibTeX

1475.

Roberts, Nicholas; Khodak, Mikhail; Dao, Tri; Li, Liam; é, Christopher R; Talwalkar, Ameet

Rethinking Neural Operations for Diverse Tasks Technical Report

2021.

Links | BibTeX

1474.

He, Yufan; Yang, Dong; Roth, Holger; Zhao, Can; Xu, Daguang

DiNTS: Differentiable Neural Network Topology Search for 3D Medical Image Segmentation Technical Report

2021.

Links | BibTeX

1473.

Schmidgall, Samuel

Self-Constructing Neural Networks Through Random Mutation Technical Report

2021.

Links | BibTeX

1472.

Guo, Shaopeng; Wang, Yujie; Yuan, Kun; Li, Quanquan

Differentiable Network Adaption with Elastic Search Space Technical Report

2021.

Links | BibTeX

1471.

Zappella, Giovanni; Salinas, David; Archambeau, Cédric

A resource-efficient method for repeated HPO and NAS problems Technical Report

2021.

Links | BibTeX

1470.

Wang, J; Zhao, J; An, J; Wang, D; Qiu, M

A Linear NAS Service of ConvNets for Fast Deployment in the Edge of 5G Networks Journal Article

In: IEEE Network, vol. 35, no. 2, pp. 46-52, 2021.

Links | BibTeX

1469.

Lee, Hayeon; Hyung, Eunyoung; Hwang, Sung Ju

Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets Proceedings Article

In: International Conference on Learning Representations, 2021.

Links | BibTeX

1468.

Ding, Z; Chen, Y; Li, N; Zhao, D; Sun, Z; Chen, C L P

BNAS: Efficient Neural Architecture Search Using Broad Scalable Architecture Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-15, 2021.

Links | BibTeX

1467.

-, Tien; -, Yi; Sze, Vivienne

NetAdaptV2: Efficient Neural Architecture Search with Fast Super-Network Training and Architecture Optimization Technical Report

2021.

Links | BibTeX

1466.

Hu, Shoukang; Xie, Xurong; Liu, Shansong; Cui, Mingyu; Geng, Mengzhe; Liu, Xunying; Meng, Helen

Neural Architecture Search For LF-MMI Trained Time Delay Neural Networks Proceedings Article

In: ICASSP2021, 2021.

Links | BibTeX

1465.

Wang, X; Wang, X; Jin, L; Lv, R; Dai, B; He, M; Lv, T

Evolutionary Algorithm-Based and Network Architecture Search-Enabled Multiobjective Traffic Classification Journal Article

In: IEEE Access, vol. 9, pp. 52310-52325, 2021.

Links | BibTeX

1464.

Wang, Guangrun; Lin, Liang; Chen, Rongcong; Wang, Guangcong; Zhang, Jiqi

Joint Learning of Neural Transfer and Architecture Adaptation for Image Recognition Journal Article

In: IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021.

Links | BibTeX

1463.

Prabakaran, B S; Akhtar, A; Rehman, S; Hasan, O; Shafique, M

BioNetExplorer: Architecture-Space Exploration of Bio-Signal Processing Deep Neural Networks for Wearables Journal Article

In: IEEE Internet of Things Journal, pp. 1-1, 2021.

Links | BibTeX

1462.

Tan, Mingxing; Le, Quoc V

EfficientNetV2: Smaller Models and Faster Training Technical Report

2021.

Links | BibTeX

1461.

Liang, Y; Lu, L; Jin, Y; Xie, J; Huang, R; Zhang, J; Lin, W

An Efficient Hardware Design for Accelerating Sparse CNNs with NAS-based Models Journal Article

In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2021.

Links | BibTeX

1460.

ElSaid, AbdElRahman A.; Karns, Joshua; Lyu, Zimeng; II, Alexander G. Ororbia; Desell, Travis

Continuous Ant-Based Neural Topology Search Proceedings Article

In: Castillo, Pedro A.; Laredo, Juan Luis Jim'enez (Ed.): Applications of Evolutionary Computation: 24th International Conference, EvoApplications 2021, Held as Part of EvoStar 2021, Virtual Event, April 7--9, 2021, Proceedings, pp. 291, Springer Nature 2021.

Links | BibTeX

1459.

White, Colin; Zela, Arber; Ru, Binxin; Liu, Yang; Hutter, Frank

How Powerful are Performance Predictors in Neural Architecture Search? Technical Report

2021.

Links | BibTeX

1458.

Ren, Pengzhen; Xiao, Gang; Chang, Xiaojun; Xiao, Yun; Li, Zhihui; Chen, Xiaojiang

NAS-TC: Neural Architecture Search on Temporal Convolutions for Complex Action Recognition Technical Report

2021.

Links | BibTeX

1457.

Dong, Heyou; Chen, Dan; Zhang, Lei; Ke, Hengjin; Li, Xiaoli

Subject Sensitive EEG Discrimination with Fast Reconstructable CNN Driven by Reinforcement Learning: A Case Study of ASD Evaluation Journal Article

In: Neurocomputing, 2021, ISSN: 0925-2312.

Abstract | Links | BibTeX

1456.

Shi, Xian; Zhou, Pan; Chen, Wei; Xie, Lei

Darts-Conformer: Towards Efficient Gradient-Based Neural Architecture Search For End-to-End ASR Technical Report

2021.

Links | BibTeX

1455.

Ganepola, Vayangi Vishmi Vishara; Wirasingha, Torin

Automating Generative Adversarial Networks using Neural Architecture Search: A Review Proceedings Article

In: 2021 International Conference on Emerging Smart Computing and Informatics (ESCI), pp. 577-582, 2021.

Links | BibTeX

1454.

Liu, Hongying; Xu, Derong; Zhu, Tianwen; Shang, Fanhua; Liu, Yuanyuan; Lu, Jianhua; Yang, Ri

Graph Convolutional Networks by Architecture Search for PolSAR Image Classification Journal Article

In: Remote Sensing, vol. 13, no. 7, 2021, ISSN: 2072-4292.

Abstract | Links | BibTeX

1453.

Ge, Wanying; Panariello, Michele; Patino, Jose; Todisco, Massimiliano; Evans, Nicholas W D

Partially-Connected Differentiable Architecture Search for Deepfake and Spoofing Detection Technical Report

2021.

Links | BibTeX

1452.

Yu, Kaicheng; é, Ren; Salzmann, Mathieu

Landmark Regularization: Ranking Guided Super-Net Training in Neural Architecture Search Technical Report

2021.

Links | BibTeX

3651 entries « 44 of 74 »