AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4236 entries « 80 of 85 »

2019

286.

Yousefzadeh, Roozbeh; O'Leary, Dianne P

Refining the Structure of Neural Networks Using Matrix Conditioning Technical Report

2019.

Links | BibTeX

285.

Shaw, Albert E; Hunter, Daniel; Landola, Forrest; Sidhu, Sammy

SqueezeNAS - Fast Neural Architecture Search for Faster Semantic Segmentation Proceedings Article

In: pp. 2014-2024, 2019.

Links | BibTeX

284.

Wang, Bin; Sun, Yanan; Xue, Bing; Zhang, Mengjie

Evolving deep neural networks by multi-objective particle swarm optimization for image classification Proceedings Article

In: pp. 490-498, 2019.

Links | BibTeX

283.

Liu, Peiye; Wu, Bo; Ma, Huadong; Chundi, Pavan Kumar; Seok, Mingoo

MemNet - Memory-Efficiency Guided Neural Architecture Search with Augment-Trim learning Technical Report

2019.

Links | BibTeX

282.

Zhang, Miao; Li, Huiqi; Pan, Shirui; Liu, Taoping; Su, Steven W

Efficient Novelty-Driven Neural Architecture Search Technical Report

2019.

Links | BibTeX

281.

Xu, Yuhui; Xie, Lingxi; Zhang, Xiaopeng; Chen, Xin; Qi, Guo-Jun; Tian, Qi; Xiong, Hongkai

PC-DARTS - Partial Channel Connections for Memory-Efficient Differentiable Architecture Search Technical Report

2019.

Links | BibTeX

280.

Zhou, Yanqi; Wang, Peng

EPNAS - Efficient Progressive Neural Architecture Search Proceedings Article

In: pp. 71, 2019.

Links | BibTeX

279.

Peng, Wei; Hong, Xiaopeng; Zhao, Guoying

Video Action Recognition Via Neural Architecture Searching Proceedings Article

In: pp. 11-15, 2019.

Links | BibTeX

278.

Zhang, Xinyi; Jiang, Weiwen; Shi, Yiyu; Hu, Jingtong

When Neural Architecture Search Meets Hardware Implementation - from Hardware Awareness to Co-Design Proceedings Article

In: pp. 25-30, 2019.

Links | BibTeX

277.

Jaâfra, Yesmina; Laurent, Jean Luc; Deruyver, Aline; Naceur, Mohamed Saber

Reinforcement learning for neural architecture search - A review Journal Article

In: vol. 89, pp. 57-66, 2019.

Links | BibTeX

276.

Li, Yaoman; King, Irwin

Architecture Search for Image Inpainting Proceedings Article

In: pp. 106-115, 2019.

Links | BibTeX

275.

Märtens, Marcus; Izzo, Dario

Neural network architecture search with differentiable cartesian genetic programming for regression Proceedings Article

In: pp. 181-182, 2019.

Links | BibTeX

274.

Chu, Xiangxiang; Zhang, Bo; Xu, Ruijun; Li, Jixiang

FairNAS - Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search Proceedings Article

In: International Conference on Computer Vision 2021, 2019.

Links | BibTeX

273.

Lakhmiri, Dounia; Digabel, Sébastien Le; Tribes, Christophe

HyperNOMAD - Hyperparameter optimization of deep neural networks using mesh adaptive direct search Technical Report

2019.

Links | BibTeX

272.

Behjat, Amir; Chidambaran, Sharat; Chowdhury, Souma

Adaptive Genomic Evolution of Neural Network Topologies (AGENT) for State-to-Action Mapping in Autonomous Agents Proceedings Article

In: pp. 9638-9644, 2019.

Links | BibTeX

271.

Cheng, Hsin-Pai; Zhang, Tunhou; Yang, Yukun; Yan, Feng; Li, Shiyu; Teague, Harris; Li, Hai Helen; Chen, Yiran

SwiftNet - Using Graph Propagation as Meta-knowledge to Search Highly Representative Neural Architectures Technical Report

2019.

Links | BibTeX

270.

Borsos, Zalán; Khorlin, Andrey; Gesmundo, Andrea

Transfer NAS - Knowledge Transfer between Search Spaces with Transformer Agents Technical Report

2019.

Links | BibTeX

269.

Nayman, Niv; Noy, Asaf; Ridnik, Tal; Friedman, Itamar; Jin, Rong; Zelnik-Manor, Lihi

XNAS - Neural Architecture Search with Expert Advice Proceedings Article

In: pp. 1975-1985, 2019.

Links | BibTeX

268.

Singh, Prabhant; Jacobs, Tobias; Nicolas, Sebastien; Schmidt, Mischa

A Study of the Learning Progress in Neural Architecture Search Techniques Technical Report

2019.

Links | BibTeX

267.

Srinivas, Sai Vineeth Kalluru; Nair, Harideep; Vidyasagar, Vinay

Hardware Aware Neural Network Architectures using FbNet Technical Report

2019.

Links | BibTeX

266.

Wang, Linnan; Xie, Saining; Li, Teng; Fonseca, Rodrigo; Tian, Yuandong

Sample-Efficient Neural Architecture Search by Learning Action Space Technical Report

2019.

Links | BibTeX

265.

Cheng, Hsin-Pai; Zhang, Tunhou; Yang, Yukun; Yan, Feng; Li, Shiyu; Teague, Harris; Li, Hai Helen; Chen, Yiran

SwiftNet - Using Graph Propagation as Meta-knowledge to Search Highly Representative Neural Architectures Technical Report

2019.

Links | BibTeX

264.

Yu, Qihang; Yang, Dong; Roth, Holger; Bai, Yutong; Zhang, Yixiao; Yuille, Alan L; Xu, Daguang

C2FNAS: Coarse-to-Fine Neural Architecture Search for 3D Medical Image Segmentation Technical Report

2019.

Links | BibTeX

263.

Pasunuru, Ramakanth; Bansal, Mohit

Continual and Multi-Task Architecture Search Proceedings Article

In: pp. 1911-1922, 2019.

Links | BibTeX

262.

Cho, Minsu; Soltani, Mohammadreza; Hegde, Chinmay

One-Shot Neural Architecture Search via Compressive Sensing Technical Report

2019.

Links | BibTeX

261.

Zhu, Zhuotun; Liu, Chenxi; Yang, Dong; Yuille, Alan L; Xu, Daguang

V-NAS - Neural Architecture Search for Volumetric Medical Image Segmentation Proceedings Article

In: pp. 240-248, 2019.

Links | BibTeX

260.

An, Jie; Xiong, Haoyi; Ma, Jinwen; Luo, Jiebo; Huan, Jun

StyleNAS - An Empirical Study of Neural Architecture Search to Uncover Surprisingly Fast End-to-End Universal Style Transfer Networks Technical Report

2019.

Links | BibTeX

259.

Hu, Hanzhang; Langford, John; Caruana, Rich; Mukherjee, Saurajit; Horvitz, Eric; Dey, Debadeepta

Efficient Forward Architecture Search Proceedings Article

In: pp. 10122-10131, 2019.

Links | BibTeX

258.

Yao, Quanming; Xu, Ju; Tu, Wei-Wei; Zhu, Zhanxing

Differentiable Neural Architecture Search via Proximal Iterations Technical Report

2019.

Links | BibTeX

257.

Zheng, Xiawu; Ji, Rongrong; Tang, Lang; Wan, Yan; Zhang, Baochang; Wu, Yongjian; Wu, Yunsheng; Shao, Ling

Dynamic Distribution Pruning for Efficient Network Architecture Search Technical Report

2019.

Links | BibTeX

256.

Junior, Francisco Erivaldo Fernandes; Yen, Gary G

Particle swarm optimization of deep neural networks architectures for image classification Journal Article

In: vol. 49, pp. 62-74, 2019.

Links | BibTeX

255.

Radosavovic, Ilija; Johnson, Justin; Xie, Saining; Lo, Wan-Yen; Dollár, Piotr

On Network Design Spaces for Visual Recognition Proceedings Article

In: pp. 1882-1890, 2019.

Links | BibTeX

254.

Tan, Mingxing; Le, Quoc V

EfficientNet - Rethinking Model Scaling for Convolutional Neural Networks Proceedings Article

In: pp. 6105-6114, 2019.

Links | BibTeX

253.

Pahuja, Vardaan; Fu, Jie; Chandar, Sarath; Pal, Christopher Joseph

Structure Learning for Neural Module Networks Proceedings Article

In: pp. 1-10, 2019.

Links | BibTeX

252.

Fedorov, Igor; Adams, Ryan P; Mattina, Matthew; Whatmough, Paul N

SpArSe - Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers Proceedings Article

In: pp. 4978-4990, 2019.

Links | BibTeX

251.

Dong, Xuanyi; Yang, Yi

Network Pruning via Transformable Architecture Search Proceedings Article

In: pp. 759-770, 2019.

Links | BibTeX

250.

Cho, Hyunghun; Kim, Yongjin; Lee, Eunjung; Choi, Daeyoung; Lee, Yongjae; Rhee, Wonjong

DEEP-BO for Hyperparameter Optimization of Deep Networks Technical Report

2019.

Links | BibTeX

249.

Akimoto, Youhei; Shirakawa, Shinichi; Yoshinari, Nozomu; Uchida, Kento; Saito, Shota; Nishida, Kouhei

Adaptive Stochastic Natural Gradient Method for One-Shot Neural Architecture Search Proceedings Article

In: pp. 171-180, 2019.

Links | BibTeX

248.

Zheng, Xiawu; Ji, Rongrong; Tang, Lang; Zhang, Baochang; Liu, Jianzhuang; Tian, Qi

Multinomial Distribution Learning for Effective Neural Architecture Search Proceedings Article

In: pp. 1304-1313, 2019.

Links | BibTeX

247.

Zhu, Hui; An, Zhulin; Yang, Chuanguang; Xu, Kaiqiang; Zhao, Erhu; Xu, Yongjun

EENA - Efficient Evolution of Neural Architecture Proceedings Article

In: pp. 1891-1899, 2019.

Links | BibTeX

246.

Byla, Edvinas; Pang, Wei

DeepSwarm - Optimising Convolutional Neural Networks Using Swarm Intelligence Proceedings Article

In: pp. 119-130, 2019.

Links | BibTeX

245.

Saikia, Tonmoy; Marrakchi, Yassine; Zela, Arber; Hutter, Frank; Brox, Thomas

AutoDispNet - Improving Disparity Estimation With AutoML Proceedings Article

In: pp. 1812-1823, 2019.

Links | BibTeX

244.

Lin, Chen; Guo, Minghao; Li, Chuming; Yuan, Xin; Wu, Wei; Yan, Junjie; Lin, Dahua; Ouyang, Wanli

Online Hyper-Parameter Learning for Auto-Augmentation Strategy Proceedings Article

In: pp. 6578-6587, 2019.

Links | BibTeX

243.

Saltori, Cristiano; Roy, Subhankar; Sebe, Nicu; Iacca, Giovanni

Regularized Evolutionary Algorithm for Dynamic Neural Topology Search Proceedings Article

In: pp. 219-230, 2019.

Links | BibTeX

242.

Ma, Lizheng; Cui, Jiaxu; Yang, Bo

Deep Neural Architecture Search with Deep Graph Bayesian Optimization Proceedings Article

In: pp. 500-507, 2019.

Links | BibTeX

241.

Laredo, David; Qin, Yulin; Schütze, Oliver; Sun, Jian-Qiao

Automatic Model Selection for Neural Networks Technical Report

2019.

Links | BibTeX

240.

Klein, Aaron; Hutter, Frank

Tabular Benchmarks for Joint Architecture and Hyperparameter Optimization Technical Report

2019.

Links | BibTeX

239.

Zhou, Hongpeng; Yang, Minghao; Wang, Jun; Pan, Wei

BayesNAS - A Bayesian Approach for Neural Architecture Search Proceedings Article

In: pp. 7603-7613, 2019.

Links | BibTeX

238.

Stamoulis, Dimitrios; Ding, Ruizhou; Wang, Di; Lymberopoulos, Dimitrios; Priyantha, Bodhi; Liu, Jie; Marculescu, Diana

Single-Path NAS - Device-Aware Efficient ConvNet Design Technical Report

2019.

Links | BibTeX

237.

Assunção, Filipe; Correia, João; Conceição, Rúben; Pimenta, Mário; Tomé, Bernardo; Lourenço, Nuno; Machado, Penousal

Automatic Design of Artificial Neural Networks for Gamma-Ray Detection Journal Article

In: vol. 7, pp. 110531-110540, 2019.

Links | BibTeX

4236 entries « 80 of 85 »