AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4221 entries « 69 of 85 »

2020

821.

Li, Nannan; Chen, Yaran; Ding, Zixiang; Zhao, Dongbin

Shift-Invariant Convolutional Network Search Proceedings Article

In: pp. 1-7, 2020.

Links | BibTeX

820.

Jing, Weipeng; Ren, Quanlin; Zhou, Jun; Song, Houbing

AutoRSISC - Automatic design of neural architecture for remote sensing image scene classification Journal Article

In: vol. 140, pp. 186-192, 2020.

Links | BibTeX

819.

Liu, Haiyang; Zhang, Cheng

Reinforcement Learning based Neural Architecture Search for Audio Tagging Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

818.

Jing, Kun; Xu, Jungang; Xu, Hui

NASABN - A Neural Architecture Search Framework for Attention-Based Networks Proceedings Article

In: pp. 1-7, 2020.

Links | BibTeX

817.

Nakai, Kohei; Matsubara, Takashi; Uehara, Kuniaki

Att-DARTS - Differentiable Neural Architecture Search for Attention Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

816.

Hu, Kai; Shuo, Tian; Guo, Shasha; Li, Nan; Luo, Li; Wang, Lei

Recurrent Neural Architecture Search based on Randomness-Enhanced Tabu Algorithm Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

815.

Cioflan, Cristian; Timofte, Radu

MS-RANAS - Multi-Scale Resource-Aware Neural Architecture Search Technical Report

2020.

Links | BibTeX

814.

Zheng, Xinyue; Wang, Peng; Wang, Qigang; Shi, Zhongchao

Disentangled Neural Architecture Search Technical Report

2020.

Links | BibTeX

813.

Tyagi, Anjul; Xie, Cong; Mueller, Klaus

Visual Steering for One-Shot Deep Neural Network Synthesis Technical Report

2020.

Links | BibTeX

812.

Zhang, Yongqi

Autokge: towards automated knowledge graph embedding Technical Report

2020.

Links | BibTeX

811.

Gao, Peng; Hori, Chiori; Geng, Shijie; Hori, Takaaki; Roux, Jonathan Le

Multi-Pass Transformer for Machine Translation Technical Report

2020.

Links | BibTeX

810.

Zhu, Wei; Qiu, Xipeng; Ni, Yuan; Xie, Guotong

AutoRC - Improving BERT Based Relation Classification Models via Architecture Search Technical Report

2020.

Links | BibTeX

809.

Cooper, Alexis; Zhou, Xin; Heidbrink, Scott; Dunlavy, Daniel M

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models Technical Report

2020.

Links | BibTeX

808.

Shi, Min; Wilson, David A; Zhu, Xingquan; Huang, Yu; Zhuang, Yuan; Liu, Jianxun; Tang, Yufei

Evolutionary Architecture Search for Graph Neural Networks Technical Report

2020.

Links | BibTeX

807.

Achararit, Paniti; Hanif, Muhammad Abdullah; Putra, Rachmad Vidya Wicaksana; Shafique, Muhammad; Hara-Azumi, Yuko

APNAS - Accuracy-and-Performance-Aware Neural Architecture Search for Neural Hardware Accelerators Journal Article

In: vol. 8, pp. 165319-165334, 2020.

Links | BibTeX

806.

Zhao, Yiren; Wang, Duo; Bates, Daniel; Mullins, Robert D; Jamnik, Mateja; Liò, Pietro

Learned Low Precision Graph Neural Networks Technical Report

2020.

Links | BibTeX

805.

Machida, Kengo; Uto, Kuniaki; Shinoda, Koichi; Suzuki, Taiji

Neural Architecture Search Using Stable Rank of Convolutional Layers Technical Report

2020.

Links | BibTeX

804.

Yuan, Zhihang; Liu, Xin; Wu, Bingzhe; Sun, Guangyu

ENAS4D - Efficient Multi-stage CNN Architecture Search for Dynamic Inference Technical Report

2020.

Links | BibTeX

803.

Jing, Weipeng; Lin, Jingbo; Wang, Huihui

Building NAS: Automatic designation of efficient neural architectures for building extraction in high-resolution aerial images Technical Report

2020, ISSN: 0262-8856.

Links | BibTeX

802.

Ding, Zixiang; Chen, Yaran; Li, Nannan; Zhao, Dongbin

Faster Gradient-based NAS Pipeline Combining Broad Scalable Architecture with Confident Learning Rate Technical Report

2020.

Links | BibTeX

801.

Ortiz, Marc; Scheidegger, Florian; Casas, Marc; Malossi, Cristiano; Ayguadé, Eduard

Generating Efficient DNN-Ensembles with Evolutionary Computation Technical Report

2020.

Links | BibTeX

800.

Yang, Zhaohui; Wang, Yunhe; Han, Kai; Xu, Chunjing; Xu, Chao; Tao, Dacheng; Xu, Chang

Searching for Low-Bit Weights in Quantized Neural Networks Proceedings Article

In: 2020.

Links | BibTeX

799.

Broni-Bediako, Clifford; Murata, Yuki; Mormille, Luiz Henrique; Atsumi, Masayasu

Evolutionary NAS with Gene Expression Programming of Cellular Encoding Technical Report

2020.

Links | BibTeX

798.

Ji, Yuanfeng; Zhang, Ruimao; Li, Zhen; Ren, Jiamin; Zhang, Shaoting; Luo, Ping

UXNet - Searching Multi-level Feature Aggregation for 3D Medical Image Segmentation Proceedings Article

In: pp. 346-356, 2020.

Links | BibTeX

797.

Wang, Ching-Chen; Chiu, Ching-Te; Chang, Jheng-Yi

EfficientNet-eLite - Extremely Lightweight and Efficient CNN Models for Edge Devices by Network Candidate Search Technical Report

2020.

Links | BibTeX

796.

Niu, Wei; Kong, Zhenglun; Yuan, Geng; Jiang, Weiwen; Guan, Jiexiong; Ding, Caiwen; Zhao, Pu; Liu, Sijia; Ren, Bin; Wang, Yanzhi

Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization Technical Report

2020.

Links | BibTeX

795.

Choi, Kanghyun; Hong, Deokki; Yoon, Hojae; Yu, Joonsang; Kim, Youngsok; Lee, Jinho

DANCE - Differentiable Accelerator/Network Co-Exploration Technical Report

2020.

Links | BibTeX

794.

Tan, Hao; Cheng, Ran; Huang, Shihua; He, Cheng; Qiu, Changxiao; Yang, Fan; Luo, Ping

RelativeNAS - Relative Neural Architecture Search via Slow-Fast Learning Proceedings Article

In: 2020.

Links | BibTeX

793.

Colangelo, Philip; Segal, Oren; Speicher, Alexander; Margala, Martin

AutoML for Multilayer Perceptron and FPGA Co-design Technical Report

2020.

Links | BibTeX

792.

Zhu, Hangyu; Zhang, Haoyu; Jin, Yaochu

From Federated Learning to Federated Neural Architecture Search - A Survey Technical Report

2020.

Links | BibTeX

791.

Colombo, Nicolò; Gao, Yang

Disentangling Neural Architectures and Weights - A Case Study in Supervised Classification Technical Report

2020.

Links | BibTeX

790.

Wang, Yuke; Feng, Boyuan; Peng, Xueqiao; Ding, Yufei

Optimizing Convolutional Neural Network Architecture via Information Field Technical Report

2020.

Links | BibTeX

789.

Chen, Hanlin; Zhuo, Li'an; Zhang, Baochang; Zheng, Xiawu; Liu, Jianzhuang; Ji, Rongrong; Doermann, David S; Guo, Guodong

Binarized Neural Architecture Search for Efficient Object Recognition Technical Report

2020.

Links | BibTeX

788.

Zhao, Shen; Potter, Lee C; Ahmad, Rizwan

Calibrationless MRI Reconstruction with a Plug-in Denoiser Technical Report

2020.

Links | BibTeX

787.

Zhang, Bo; Li, WenFeng; Li, Qingyuan; Zhuang, Weiji; Chu, Xiangxiang; Wang, Yujun

AutoKWS - Keyword Spotting with Differentiable Architecture Search Technical Report

2020.

Links | BibTeX

786.

Liu, Yang; Qin, Zhenyue; Anwar, Saeed; Caldwell, Sabrina B; Gedeon, Tom

Are Deep Neural Architectures Losing Information? Invertibility is Indispensable Proceedings Article

In: pp. 172-184, 2020.

Links | BibTeX

785.

Zhu, Wei; Wang, Xiaoling; Qiu, Xipeng; Ni, Yuan; Xie, Guotong

AutoTrans - Automating Transformer Design via Reinforced Architecture Search Technical Report

2020.

Links | BibTeX

784.

Lee, Jaeseong; Kang, Duseok; Ha, Soonhoi

S3NAS - Fast NPU-aware Neural Architecture Search Methodology Technical Report

2020.

Links | BibTeX

783.

Dong, Minjing; Li, Yanxi; Wang, Yunhe; Xu, Chang

Adversarially Robust Neural Architectures Technical Report

2020.

Links | BibTeX

782.

Ye, Weiliang; Liu, Ruijiao; Li, Yangyang; Jiao, Licheng

Quantum-Inspired Evolutionary Algorithm for Convolutional Neural Networks Architecture Search Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

781.

Zhao, Zhenyao; Jiang, Min; Guo, Shihui; Wang, Zhenzhong; Chao, Fei; Tan, Kay Chen

Improving Deep Learning based Optical Character Recognition via Neural Architecture Search Proceedings Article

In: pp. 1-7, 2020.

Links | BibTeX

780.

Dong, Xuanyi; Liu, Lu; Musial, Katarzyna; Gabrys, Bogdan

NATS-Bench - Benchmarking NAS algorithms for Architecture Topology and Size Technical Report

2020.

Links | BibTeX

779.

Chen, Xiaokai; Gu, Xiaoguang; Fu, Libo

Boosting share routing for multi-task learning Technical Report

2020.

Links | BibTeX

778.

Chen, Xuan-Jun; Fuh, Chiou-Shann

MNET: Fruit Lesion Classification Convnet Design via Efficient Neural Architecture Search Technical Report

2020.

Links | BibTeX

777.

Zhang, Xinbang; Chang, Jianlong; Guo, Yiwen; Meng, Gaofeng; Lin, Zhouchen; Xiang, Shiming; Pan, Chunhong

DATA: Differentiable ArchiTecture Approximation with Distribution Guided Sampling Technical Report

2020.

Links | BibTeX

776.

Lu, Bingqian; Yang, Jianyi; Ren, Shaolei

Scaling Up Deep Neural Network Optimization for Edge Inference Technical Report

2020.

Links | BibTeX

775.

Xie, Sirui; Hu, Shoukang; Wang, Xinjiang; Liu, Chunxiao; Shi, Jianping; Liu, Xunying; Lin, Dahua

Understanding the wiring evolution in differentiable neural architecture search Technical Report

2020.

Links | BibTeX

774.

Mo, Tong; Yu, Yakun; Salameh, Mohammad; Niu, Di; Jui, Shangling

Neural Architecture Search for Keyword Spotting Proceedings Article

In: pp. 1982-1986, 2020.

Links | BibTeX

773.

Kotb, Hazem; Elhelw, Mohamed; Sakr, Sherif

AutoDLCon - An Approach for Controlling the Automated Tuning for Deep Learning Networks Proceedings Article

In: pp. 157-164, 2020.

Links | BibTeX

772.

Li, Yinqi; Xu, Lu; Shu, Weihua; Tao, Ji'an; Mei, Kuizhi

AutoGesNet: Auto Gesture Recognition Network Based on Neural Architecture Search Technical Report

2020.

Links | BibTeX

4221 entries « 69 of 85 »