AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


2801 entries « 41 of 57 »

2020

801.

Jing, Weipeng; Ren, Quanlin; Zhou, Jun; Song, Houbing

AutoRSISC - Automatic design of neural architecture for remote sensing image scene classification Journal Article

In: vol. 140, pp. 186-192, 2020.

Links | BibTeX

800.

Liu, Haiyang; Zhang, Cheng

Reinforcement Learning based Neural Architecture Search for Audio Tagging Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

799.

Jing, Kun; Xu, Jungang; Xu, Hui

NASABN - A Neural Architecture Search Framework for Attention-Based Networks Proceedings Article

In: pp. 1-7, 2020.

Links | BibTeX

798.

Nakai, Kohei; Matsubara, Takashi; Uehara, Kuniaki

Att-DARTS - Differentiable Neural Architecture Search for Attention Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

797.

Hu, Kai; Shuo, Tian; Guo, Shasha; Li, Nan; Luo, Li; Wang, Lei

Recurrent Neural Architecture Search based on Randomness-Enhanced Tabu Algorithm Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

796.

Cioflan, Cristian; Timofte, Radu

MS-RANAS - Multi-Scale Resource-Aware Neural Architecture Search Technical Report

2020.

Links | BibTeX

795.

Zheng, Xinyue; Wang, Peng; Wang, Qigang; Shi, Zhongchao

Disentangled Neural Architecture Search Technical Report

2020.

Links | BibTeX

794.

Tyagi, Anjul; Xie, Cong; Mueller, Klaus

Visual Steering for One-Shot Deep Neural Network Synthesis Technical Report

2020.

Links | BibTeX

793.

Zhang, Yongqi

Autokge: towards automated knowledge graph embedding Technical Report

2020.

Links | BibTeX

792.

Gao, Peng; Hori, Chiori; Geng, Shijie; Hori, Takaaki; Roux, Jonathan Le

Multi-Pass Transformer for Machine Translation Technical Report

2020.

Links | BibTeX

791.

Zhu, Wei; Qiu, Xipeng; Ni, Yuan; Xie, Guotong

AutoRC - Improving BERT Based Relation Classification Models via Architecture Search Technical Report

2020.

Links | BibTeX

790.

Cooper, Alexis; Zhou, Xin; Heidbrink, Scott; Dunlavy, Daniel M

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models Technical Report

2020.

Links | BibTeX

789.

Shi, Min; Wilson, David A; Zhu, Xingquan; Huang, Yu; Zhuang, Yuan; Liu, Jianxun; Tang, Yufei

Evolutionary Architecture Search for Graph Neural Networks Technical Report

2020.

Links | BibTeX

788.

Achararit, Paniti; Hanif, Muhammad Abdullah; Putra, Rachmad Vidya Wicaksana; Shafique, Muhammad; Hara-Azumi, Yuko

APNAS - Accuracy-and-Performance-Aware Neural Architecture Search for Neural Hardware Accelerators Journal Article

In: vol. 8, pp. 165319-165334, 2020.

Links | BibTeX

787.

Zhao, Yiren; Wang, Duo; Bates, Daniel; Mullins, Robert D; Jamnik, Mateja; Liò, Pietro

Learned Low Precision Graph Neural Networks Technical Report

2020.

Links | BibTeX

786.

Machida, Kengo; Uto, Kuniaki; Shinoda, Koichi; Suzuki, Taiji

Neural Architecture Search Using Stable Rank of Convolutional Layers Technical Report

2020.

Links | BibTeX

785.

Yuan, Zhihang; Liu, Xin; Wu, Bingzhe; Sun, Guangyu

ENAS4D - Efficient Multi-stage CNN Architecture Search for Dynamic Inference Technical Report

2020.

Links | BibTeX

784.

Jing, Weipeng; Lin, Jingbo; Wang, Huihui

Building NAS: Automatic designation of efficient neural architectures for building extraction in high-resolution aerial images Technical Report

2020, ISSN: 0262-8856.

Links | BibTeX

783.

Ding, Zixiang; Chen, Yaran; Li, Nannan; Zhao, Dongbin

Faster Gradient-based NAS Pipeline Combining Broad Scalable Architecture with Confident Learning Rate Technical Report

2020.

Links | BibTeX

782.

Ortiz, Marc; Scheidegger, Florian; Casas, Marc; Malossi, Cristiano; Ayguadé, Eduard

Generating Efficient DNN-Ensembles with Evolutionary Computation Technical Report

2020.

Links | BibTeX

781.

Yang, Zhaohui; Wang, Yunhe; Han, Kai; Xu, Chunjing; Xu, Chao; Tao, Dacheng; Xu, Chang

Searching for Low-Bit Weights in Quantized Neural Networks Proceedings Article

In: 2020.

Links | BibTeX

780.

Broni-Bediako, Clifford; Murata, Yuki; Mormille, Luiz Henrique; Atsumi, Masayasu

Evolutionary NAS with Gene Expression Programming of Cellular Encoding Technical Report

2020.

Links | BibTeX

779.

Ji, Yuanfeng; Zhang, Ruimao; Li, Zhen; Ren, Jiamin; Zhang, Shaoting; Luo, Ping

UXNet - Searching Multi-level Feature Aggregation for 3D Medical Image Segmentation Proceedings Article

In: pp. 346-356, 2020.

Links | BibTeX

778.

Wang, Ching-Chen; Chiu, Ching-Te; Chang, Jheng-Yi

EfficientNet-eLite - Extremely Lightweight and Efficient CNN Models for Edge Devices by Network Candidate Search Technical Report

2020.

Links | BibTeX

777.

Niu, Wei; Kong, Zhenglun; Yuan, Geng; Jiang, Weiwen; Guan, Jiexiong; Ding, Caiwen; Zhao, Pu; Liu, Sijia; Ren, Bin; Wang, Yanzhi

Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization Technical Report

2020.

Links | BibTeX

776.

Choi, Kanghyun; Hong, Deokki; Yoon, Hojae; Yu, Joonsang; Kim, Youngsok; Lee, Jinho

DANCE - Differentiable Accelerator/Network Co-Exploration Technical Report

2020.

Links | BibTeX

775.

Tan, Hao; Cheng, Ran; Huang, Shihua; He, Cheng; Qiu, Changxiao; Yang, Fan; Luo, Ping

RelativeNAS - Relative Neural Architecture Search via Slow-Fast Learning Proceedings Article

In: 2020.

Links | BibTeX

774.

Colangelo, Philip; Segal, Oren; Speicher, Alexander; Margala, Martin

AutoML for Multilayer Perceptron and FPGA Co-design Technical Report

2020.

Links | BibTeX

773.

Zhu, Hangyu; Zhang, Haoyu; Jin, Yaochu

From Federated Learning to Federated Neural Architecture Search - A Survey Technical Report

2020.

Links | BibTeX

772.

Colombo, Nicolò; Gao, Yang

Disentangling Neural Architectures and Weights - A Case Study in Supervised Classification Technical Report

2020.

Links | BibTeX

771.

Wang, Yuke; Feng, Boyuan; Peng, Xueqiao; Ding, Yufei

Optimizing Convolutional Neural Network Architecture via Information Field Technical Report

2020.

Links | BibTeX

770.

Chen, Hanlin; Zhuo, Li'an; Zhang, Baochang; Zheng, Xiawu; Liu, Jianzhuang; Ji, Rongrong; Doermann, David S; Guo, Guodong

Binarized Neural Architecture Search for Efficient Object Recognition Technical Report

2020.

Links | BibTeX

769.

Zhao, Shen; Potter, Lee C; Ahmad, Rizwan

Calibrationless MRI Reconstruction with a Plug-in Denoiser Technical Report

2020.

Links | BibTeX

768.

Zhang, Bo; Li, WenFeng; Li, Qingyuan; Zhuang, Weiji; Chu, Xiangxiang; Wang, Yujun

AutoKWS - Keyword Spotting with Differentiable Architecture Search Technical Report

2020.

Links | BibTeX

767.

Liu, Yang; Qin, Zhenyue; Anwar, Saeed; Caldwell, Sabrina B; Gedeon, Tom

Are Deep Neural Architectures Losing Information? Invertibility is Indispensable Proceedings Article

In: pp. 172-184, 2020.

Links | BibTeX

766.

Zhu, Wei; Wang, Xiaoling; Qiu, Xipeng; Ni, Yuan; Xie, Guotong

AutoTrans - Automating Transformer Design via Reinforced Architecture Search Technical Report

2020.

Links | BibTeX

765.

Lee, Jaeseong; Kang, Duseok; Ha, Soonhoi

S3NAS - Fast NPU-aware Neural Architecture Search Methodology Technical Report

2020.

Links | BibTeX

764.

Dong, Minjing; Li, Yanxi; Wang, Yunhe; Xu, Chang

Adversarially Robust Neural Architectures Technical Report

2020.

Links | BibTeX

763.

Ye, Weiliang; Liu, Ruijiao; Li, Yangyang; Jiao, Licheng

Quantum-Inspired Evolutionary Algorithm for Convolutional Neural Networks Architecture Search Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

762.

Zhao, Zhenyao; Jiang, Min; Guo, Shihui; Wang, Zhenzhong; Chao, Fei; Tan, Kay Chen

Improving Deep Learning based Optical Character Recognition via Neural Architecture Search Proceedings Article

In: pp. 1-7, 2020.

Links | BibTeX

761.

Dong, Xuanyi; Liu, Lu; Musial, Katarzyna; Gabrys, Bogdan

NATS-Bench - Benchmarking NAS algorithms for Architecture Topology and Size Technical Report

2020.

Links | BibTeX

760.

Chen, Xiaokai; Gu, Xiaoguang; Fu, Libo

Boosting share routing for multi-task learning Technical Report

2020.

Links | BibTeX

759.

Chen, Xuan-Jun; Fuh, Chiou-Shann

MNET: Fruit Lesion Classification Convnet Design via Efficient Neural Architecture Search Technical Report

2020.

Links | BibTeX

758.

Zhang, Xinbang; Chang, Jianlong; Guo, Yiwen; Meng, Gaofeng; Lin, Zhouchen; Xiang, Shiming; Pan, Chunhong

DATA: Differentiable ArchiTecture Approximation with Distribution Guided Sampling Technical Report

2020.

Links | BibTeX

757.

Lu, Bingqian; Yang, Jianyi; Ren, Shaolei

Scaling Up Deep Neural Network Optimization for Edge Inference Technical Report

2020.

Links | BibTeX

756.

Xie, Sirui; Hu, Shoukang; Wang, Xinjiang; Liu, Chunxiao; Shi, Jianping; Liu, Xunying; Lin, Dahua

Understanding the wiring evolution in differentiable neural architecture search Technical Report

2020.

Links | BibTeX

755.

Mo, Tong; Yu, Yakun; Salameh, Mohammad; Niu, Di; Jui, Shangling

Neural Architecture Search for Keyword Spotting Proceedings Article

In: pp. 1982-1986, 2020.

Links | BibTeX

754.

Kotb, Hazem; Elhelw, Mohamed; Sakr, Sherif

AutoDLCon - An Approach for Controlling the Automated Tuning for Deep Learning Networks Proceedings Article

In: pp. 157-164, 2020.

Links | BibTeX

753.

Li, Yinqi; Xu, Lu; Shu, Weihua; Tao, Ji'an; Mei, Kuizhi

AutoGesNet: Auto Gesture Recognition Network Based on Neural Architecture Search Technical Report

2020.

Links | BibTeX

752.

Sun, Yanan; Sun, Xian; Fang, Yuhan; Yen, Gary

A Novel Training Protocol for Performance Predictors of Evolutionary Neural Architecture Search Algorithms Technical Report

2020.

Links | BibTeX

2801 entries « 41 of 57 »