AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4236 entries « 78 of 85 »

2019

386.

Humbatova, Nargiz; Jahangirova, Gunel; Bavota, Gabriele; Riccio, Vincenzo; Stocco, Andrea; Tonella, Paolo

Taxonomy of Real Faults in Deep Learning Systems Technical Report

2019.

Links | BibTeX

385.

ElSaid, AbdElRahman A; Ororbia, Alexander G; Desell, Travis J

The Ant Swarm Neuro-Evolution Procedure for Optimizing Recurrent Networks Technical Report

2019.

Links | BibTeX

384.

Tan, Hao; He, Cheng; Tang, Dexuan; Cheng, Ran

Efficient Evolutionary Neural Architecture Search (NAS) by Modular Inheritable Crossover Proceedings Article

In: pp. 761-769, 2019.

Links | BibTeX

383.

Johner, Fabio Marco; Wassner, Jürgen

Efficient Evolutionary Architecture Search for CNN Optimization on GTSRB Proceedings Article

In: pp. 56-61, 2019.

Links | BibTeX

382.

Lu, Bingqian; Yang, Jianyi; Chen, Lydia Y; Ren, Shaolei

Automating Deep Neural Network Model Selection for Edge Inference Proceedings Article

In: pp. 184-193, 2019.

Links | BibTeX

381.

Yang, Yang; Wang, Chao; Gong, Lei; Zhou, Xuehai

FPNet - Customized Convolutional Neural Network for FPGA Platforms Proceedings Article

In: pp. 399-402, 2019.

Links | BibTeX

380.

Wang, Lanfei; Xie, Lingxi; Zhang, Tianyi; Guo, Jun; Tian, Qi

Scalable NAS with Factorizable Architectural Parameters Technical Report

2019.

Links | BibTeX

379.

Malekhosseini, Emad; Hajabdollahi, Mohsen; Karimi, Nader; Samavi, Shadrokh

Modeling Neural Architecture Search Methods for Deep Networks Technical Report

2019.

Links | BibTeX

378.

Zhou, Xin; Dou, Dejing; Li, Boyang

Searching for Stage-wise Neural Graphs In the Limit Technical Report

2019.

Links | BibTeX

377.

Jin, Xiaojie; Wang, Jiang; Slocum, Joshua; Yang, Ming-Hsuan; Dai, Shengyang; Yan, Shuicheng; Feng, Jiashi

RC-DARTS - Resource Constrained Differentiable Architecture Search Technical Report

2019.

Links | BibTeX

376.

Singh, Animesh; Saha, Sandip; Sarkhel, Ritesh; Kundu, Mahantapas; Nasipuri, Mita; Das, Nibaran

A Genetic Algorithm based Kernel-size Selection Approach for a Multi-column Convolutional Neural Network Technical Report

2019.

Links | BibTeX

375.

Fang, Muyuan; Wang, Qiang; Zhong, Zhao

BETANAS - BalancEd TrAining and selective drop for Neural Architecture Search Technical Report

2019.

Links | BibTeX

374.

Chen, Xin; Xie, Lingxi; Wu, Jun; Tian, Qi

Progressive DARTS - Bridging the Optimization Gap for NAS in the Wild Technical Report

2019.

Links | BibTeX

373.

Qiang, Ning; Ge, Bao; Dong, Qinglin; Ge, Fangfei; Liu, Tianming

Neural Architecture Search for Optimizing Deep Belief Network Models of fMRI Data Proceedings Article

In: pp. 26-34, 2019.

Links | BibTeX

372.

Zhang, Shuang; Xiang, Liyao; Li, Congcong; Wang, Yixuan; Liu, Zeyu; Zhang, Quanshi; Li, Bo

Preventing Information Leakage with Neural Architecture Search Technical Report

2019.

Links | BibTeX

371.

Deng, Zhijie; Luo, Yucen; Zhu, Jun; Zhang, Bo

DBSN: Measuring Uncertainty through Bayesian Learning of Deep Neural Network Structures Technical Report

2019.

Links | BibTeX

370.

Friede, David; Lukasik, Jovita; Stuckenschmidt, Heiner; Keuper, Margret

A Variational-Sequential Graph Autoencoder for Neural Architecture Performance Prediction Technical Report

2019.

Links | BibTeX

369.

Hassantabar, Shayan; Dai, Xiaoliang; Jha, Niraj K

STEERAGE - Synthesis of Neural Networks Using Architecture Search and Grow-and-Prune Methods Technical Report

2019.

Links | BibTeX

368.

Baruwa, Ahmed; Abisiga, Mojeed; Gbadegesin, Ibrahim; Fakunle, Afeez

Leveraging End-to-End Speech Recognition with Neural Architecture Search Technical Report

2019.

Links | BibTeX

367.

Chen, Shoufa; Chen, Yunpeng; Yan, Shuicheng; Feng, Jiashi

Efficient Differentiable Neural Architecture Search with Meta Kernels Technical Report

2019.

Links | BibTeX

366.

Doveh, Sivan; Schwartz, Eli; Xue, Chao; Feris, Rogério Schmidt; Bronstein, Alexander M; Giryes, Raja; Karlinsky, Leonid

MetAdapt - Meta-Learned Task-Adaptive Architecture for Few-Shot Classification Technical Report

2019.

Links | BibTeX

365.

Li, Changlin; Peng, Jiefeng; Yuan, Liuchun; Wang, Guangrun; Liang, Xiaodan; Lin, Liang; Chang, Xiaojun

Blockwisely Supervised Neural Architecture Search with Knowledge Distillation Technical Report

2019.

Links | BibTeX

364.

Colangelo, Philip; Segal, Oren; Speicher, Alexander; Margala, Martin

Artificial Neural Network and Accelerator Co-design using Evolutionary Algorithms Proceedings Article

In: pp. 1-8, 2019.

Links | BibTeX

363.

Chen, Zefeng; Zhou, Yuren; Huang, Zhengxin

Auto-creation of Effective Neural Network Architecture by Evolutionary Algorithm and ResNet for Image Classification Proceedings Article

In: pp. 3895-3900, 2019.

Links | BibTeX

362.

Hong, Hyeong Gwon; Ahn, Pyunghwan; Kim, Junmo

EDAS - Efficient and Differentiable Architecture Search Technical Report

2019.

Links | BibTeX

361.

Dubatovka, Alina; Kokiopoulou, Efi; Sbaiz, Luciano; Gesmundo, Andrea; Bartók, Gábor; Berent, Jesse

Ranking architectures using meta-learning Technical Report

2019.

Links | BibTeX

360.

Xie, Xukai; Zhou, Yuan; Kung, Sun-Yuan

Exploiting Operation Importance for Differentiable Neural Architecture Search Technical Report

2019.

Links | BibTeX

359.

Shi, Han; Pi, Renjie; Xu, Hang; Li, Zhenguo; Kwok, James T; Zhang, Tong

Multi-objective Neural Architecture Search via Predictive Network Performance Optimization Technical Report

2019.

Links | BibTeX

358.

Park, Minje

Data Proxy Generation for Fast and Efficient Neural Architecture Search Technical Report

2019.

Links | BibTeX

357.

Süzen, Mehmet; Cerdà, Joan J; Weber, Cornelius

Periodic Spectral Ergodicity - A Complexity Measure for Deep Neural Networks and Neural Architecture Search Technical Report

2019.

Links | BibTeX

356.

Frachon, Luc; Pang, Wei; Coghill, George M

ImmuNeCS - Neural Committee Search by an Artificial Immune System Technical Report

2019.

Links | BibTeX

355.

Hao, Cong; Chen, Yao; Liu, Xinheng; Sarwari, Atif; Sew, Daryl; Dhar, Ashutosh; Wu, Bryan; Fu, Dongdong; Xiong, Jinjun; Hwu, Wen-Mei; Gu, Junli; Chen, Deming

NAIS - Neural Architecture and Implementation Search and its Applications in Autonomous Driving Proceedings Article

In: pp. 1-8, 2019.

Links | BibTeX

354.

Zhang, Yongqi; Yao, Quanming; Chen, Lei

Neural Recurrent Structure Search for Knowledge Graph Embedding Technical Report

2019.

Links | BibTeX

353.

Xiao, Xia; Wang, Zigeng; Rajasekaran, Sanguthevar

AutoPrune - Automatic Network Pruning by Regularizing Auxiliary Parameters Proceedings Article

In: pp. 13681-13691, 2019.

Links | BibTeX

352.

Chang, Jianlong; Zhang, Xinbang; Guo, Yiwen; Meng, Gaofeng; Xiang, Shiming; Pan, Chunhong

DATA - Differentiable ArchiTecture Approximation Proceedings Article

In: pp. 874-884, 2019.

Links | BibTeX

351.

Balaprakash, Prasanna; Egele, Romain; Salim, Misha; Wild, Stefan M; Vishwanath, Venkatram; Xia, Fangfang; Brettin, Tom; Stevens, Rick

Scalable reinforcement-learning-based neural architecture search for cancer deep learning research Proceedings Article

In: pp. 37:1-37:33, 2019.

Links | BibTeX

350.

Jiang, Yufan; Hu, Chi; Xiao, Tong; Zhang, Chunliang; Zhu, Jingbo

Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition Proceedings Article

In: pp. 3583-3588, 2019.

Links | BibTeX

349.

Jiang, Weiwen; Lou, Qiuwen; Yan, Zheyu; Yang, Lei; Hu, Jingtong; Hu, Xiaobo Sharon; Shi, Yiyu

Device-Circuit-Architecture Co-Exploration for Computing-in-Memory Neural Accelerators Technical Report

2019.

Links | BibTeX

348.

Lu, Qing; Jiang, Weiwen; Xu, Xiaowei; Shi, Yiyu; Hu, Jingtong

On Neural Architecture Search for Resource-Constrained Hardware Platforms Technical Report

2019.

Links | BibTeX

347.

Guo, Yong; Zheng, Yin; Tan, Mingkui; Chen, Qi; Chen, Jian; Zhao, Peilin; Huang, Junzhou

NAT - Neural Architecture Transformer for Accurate and Compact Architectures Proceedings Article

In: pp. 735-747, 2019.

Links | BibTeX

346.

Kwasigroch, Arkadiusz; Grochowski, Michal; Mikolajczyk, Mateusz

Deep neural network architecture search using network morphism Proceedings Article

In: pp. 30-35, 2019.

Links | BibTeX

345.

Zhang, Shizhou; Cao, Rui; Wei, Xing; Wang, Peng; Zhang, Yanning

Person Re-identification with Neural Architecture Search Proceedings Article

In: pp. 540-551, 2019.

Links | BibTeX

344.

Xiong, Yunyang; Mehta, Ronak; Singh, Vikas

Resource Constrained Neural Network Architecture Search - Will a Submodularity Assumption Help? Proceedings Article

In: pp. 1901-1910, 2019.

Links | BibTeX

343.

Xu, Hang; Yao, Lewei; Li, Zhenguo; Liang, Xiaodan; Zhang, Wei

Auto-FPN - Automatic Network Architecture Adaptation for Object Detection Beyond Classification Proceedings Article

In: pp. 6648-6657, 2019.

Links | BibTeX

342.

White, Colin; Neiswanger, Willie; Savani, Yash

BANANAS - Bayesian Optimization with Neural Architectures for Neural Architecture Search Technical Report

2019.

Links | BibTeX

341.

Bi, Kaifeng; Hu, Changping; Xie, Lingxi; Chen, Xin; Wei, Longhui; Tian, Qi

Stabilizing DARTS with Amended Gradient Estimation on Architectural Parameters Technical Report

2019.

Links | BibTeX

340.

Klaiber, Michael J; Vogel, Sebastian; Acosta, Axel; Korn, Robert; Ecco, Leonardo; Back, Kristine; Guntoro, Andre; Feldner, Ingo

An End-to-End HW/SW Co-Design Methodology to Design Efficient Deep Neural Network Systems using Virtual Models Technical Report

2019.

Links | BibTeX

339.

Kokiopoulou, Efi; Hauth, Anja; Sbaiz, Luciano; Gesmundo, Andrea; Bartok, Gabor; Berent, Jesse

Fast Task-Aware Architecture Inference Technical Report

2019.

Links | BibTeX

338.

Zhao, Ruizhe; Luk, Wayne

Efficient Structured Pruning and Architecture Searching for Group Convolution Proceedings Article

In: pp. 1961-1970, 2019.

Links | BibTeX

337.

Cai, Han; Wang, Tianzhe; Wu, Zhanghao; Wang, Kuan; Lin, Ji; Han, Song

On-Device Image Classification with Proxyless Neural Architecture Search and Quantization-Aware Fine-Tuning Proceedings Article

In: pp. 2509-2513, 2019.

Links | BibTeX

4236 entries « 78 of 85 »