AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3651 entries « 68 of 74 »

2019

301.

Litzinger, Sebastian; Klos, Andreas; Schiffmann, Wolfram

Compute-Efficient Neural Network Architecture Optimization by a Genetic Algorithm Proceedings Article

In: pp. 387-392, 2019.

Links | BibTeX

300.

Pasini, Massimiliano Lupo; Yin, Junqi; Li, Ying Wai; Eisenbach, Markus

A greedy constructive algorithm for the optimization of neural network architectures Technical Report

2019.

Links | BibTeX

299.

Ramakrishnan, Ramchalam Kinattinkara; Sari, Eyyüb; Nia, Vahid Partovi

Differentiable Mask Pruning for Neural Networks Technical Report

2019.

Links | BibTeX

298.

Liu, Chun-Ting

Neural Architecture Search in Embedding Space Technical Report

2019.

Links | BibTeX

297.

Zhou, Kaixiong; Song, Qingquan; Huang, Xiao; Hu, Xia

Auto-GNN - Neural Architecture Search of Graph Neural Networks Technical Report

2019.

Links | BibTeX

296.

Lindauer, Marius; Hutter, Frank

Best Practices for Scientific Research on Neural Architecture Search Technical Report

2019.

Links | BibTeX

295.

Peng, Junran; Sun, Ming; Zhang, Zhaoxiang; Tan, Tieniu; Yan, Junjie

Efficient Neural Architecture Transformation Search in Channel-Level for Object Detection Proceedings Article

In: pp. 14290-14299, 2019.

Links | BibTeX

294.

Liu, Yifan; Zhuang, Bohan; Shen, Chunhua; Chen, Hao; Yin, Wei

Training Compact Neural Networks via Auxiliary Overparameterization Technical Report

2019.

Links | BibTeX

293.

Zhu, Hui; An, Zhulin; Yang, Chuanguang; Hu, Xiaolong; Xu, Kaiqiang; Xu, Yongjun

Rethinking the Number of Channels for the Convolutional Neural Network Technical Report

2019.

Links | BibTeX

292.

Carlucci, Fabio Maria; Esperança, Pedro M; Singh, Marco; Gabillon, Victor; Yang, Antoine; Xu, Hang; Chen, Zewei; Wang, Jun

MANAS - Multi-Agent Neural Architecture Search Technical Report

2019.

Links | BibTeX

291.

Bae, Woong; Lee, Seungho; Lee, Yeha; Park, Beomhee; Chung, Minki; Jung, Kyu-Hwan

Resource Optimized Neural Architecture Search for 3D Medical Image Segmentation Proceedings Article

In: pp. 228-236, 2019.

Links | BibTeX

290.

Zhang, Zijun; Zhou, Linqi; Gou, Liangke; Wu, Ying Nian

Neural Architecture Search for Joint Optimization of Predictive Power and Biological Knowledge Technical Report

2019.

Links | BibTeX

289.

Balaprakash, Prasanna; Egele, Romain; Salim, Misha; Wild, Stefan M; Vishwanath, Venkatram; Xia, Fangfang; Brettin, Tom; Stevens, Rick

Scalable reinforcement-learning-based neural architecture search for cancer deep learning research Proceedings Article

In: pp. 37:1-37:33, 2019.

Links | BibTeX

288.

Sun, Li; Yu, Xiaoyi; Wang, Liuan; Sun, Jun; Inakoshi, Hiroya; Kobayashi, Ken; Kobashi, Hiromichi

Automatic Neural Network Search Method for Open Set Recognition Proceedings Article

In: pp. 4090-4094, 2019.

Links | BibTeX

287.

Yan, Shen; Fang, Biyi; Zhang, Faen; Zheng, Yu; Zeng, Xiao; Zhang, Mi; Xu, Hui

HM-NAS - Efficient Neural Architecture Search via Hierarchical Masking Proceedings Article

In: pp. 1942-1950, 2019.

Links | BibTeX

286.

Shriver, David; Xu, Dong; Elbaum, Sebastian G; Dwyer, Matthew B

Refactoring Neural Networks for Verification Technical Report

2019.

Links | BibTeX

285.

Zhou, Tianbao; Weng, Yu; Yang, Guosheng

CNASV - A Convolutional Neural Architecture Search-Train Prototype for Computer Vision Task Proceedings Article

In: pp. 380-393, 2019.

Links | BibTeX

284.

Zhang, Zhaoyang; Li, Jingyu; Shao, Wenqi; Peng, Zhanglin; Zhang, Ruimao; Wang, Xiaogang; Luo, Ping

Differentiable Learning-to-Group Channels via Groupable Convolutional Neural Networks Proceedings Article

In: pp. 3541-3550, 2019.

Links | BibTeX

283.

Irwin-Harris, William; Sun, Yanan; Xue, Bing; Zhang, Mengjie

A Graph-Based Encoding for Evolutionary Convolutional Neural Network Architecture Design Proceedings Article

In: pp. 546-553, 2019.

Links | BibTeX

282.

Verma, Mudit; Sinha, Pradyumna; Goyal, Karan; Verma, Apoorva; Susan, Seba

A Novel Framework for Neural Architecture Search in the Hill Climbing Domain Proceedings Article

In: pp. 1-8, 2019.

Links | BibTeX

281.

Tian, Haiman; Chen, Shu-Ching; Shyu, Mei-Ling; Rubin, Stuart H

Automated Neural Network Construction with Similarity Sensitive Evolutionary Algorithms Proceedings Article

In: pp. 283-290, 2019.

Links | BibTeX

280.

Gong, Xinyu; Chang, Shiyu; Jiang, Yifan; Wang, Zhangyang

AutoGAN - Neural Architecture Search for Generative Adversarial Networks Proceedings Article

In: pp. 3223-3233, 2019.

Links | BibTeX

279.

Yousefzadeh, Roozbeh; O'Leary, Dianne P

Refining the Structure of Neural Networks Using Matrix Conditioning Technical Report

2019.

Links | BibTeX

278.

Shaw, Albert E; Hunter, Daniel; Landola, Forrest; Sidhu, Sammy

SqueezeNAS - Fast Neural Architecture Search for Faster Semantic Segmentation Proceedings Article

In: pp. 2014-2024, 2019.

Links | BibTeX

277.

Wang, Bin; Sun, Yanan; Xue, Bing; Zhang, Mengjie

Evolving deep neural networks by multi-objective particle swarm optimization for image classification Proceedings Article

In: pp. 490-498, 2019.

Links | BibTeX

276.

Liu, Peiye; Wu, Bo; Ma, Huadong; Chundi, Pavan Kumar; Seok, Mingoo

MemNet - Memory-Efficiency Guided Neural Architecture Search with Augment-Trim learning Technical Report

2019.

Links | BibTeX

275.

Zhang, Miao; Li, Huiqi; Pan, Shirui; Liu, Taoping; Su, Steven W

Efficient Novelty-Driven Neural Architecture Search Technical Report

2019.

Links | BibTeX

274.

Xu, Yuhui; Xie, Lingxi; Zhang, Xiaopeng; Chen, Xin; Qi, Guo-Jun; Tian, Qi; Xiong, Hongkai

PC-DARTS - Partial Channel Connections for Memory-Efficient Differentiable Architecture Search Technical Report

2019.

Links | BibTeX

273.

Zhou, Yanqi; Wang, Peng

EPNAS - Efficient Progressive Neural Architecture Search Proceedings Article

In: pp. 71, 2019.

Links | BibTeX

272.

Peng, Wei; Hong, Xiaopeng; Zhao, Guoying

Video Action Recognition Via Neural Architecture Searching Proceedings Article

In: pp. 11-15, 2019.

Links | BibTeX

271.

Zhang, Xinyi; Jiang, Weiwen; Shi, Yiyu; Hu, Jingtong

When Neural Architecture Search Meets Hardware Implementation - from Hardware Awareness to Co-Design Proceedings Article

In: pp. 25-30, 2019.

Links | BibTeX

270.

Jaâfra, Yesmina; Laurent, Jean Luc; Deruyver, Aline; Naceur, Mohamed Saber

Reinforcement learning for neural architecture search - A review Journal Article

In: vol. 89, pp. 57-66, 2019.

Links | BibTeX

269.

Li, Yaoman; King, Irwin

Architecture Search for Image Inpainting Proceedings Article

In: pp. 106-115, 2019.

Links | BibTeX

268.

Märtens, Marcus; Izzo, Dario

Neural network architecture search with differentiable cartesian genetic programming for regression Proceedings Article

In: pp. 181-182, 2019.

Links | BibTeX

267.

Chu, Xiangxiang; Zhang, Bo; Xu, Ruijun; Li, Jixiang

FairNAS - Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search Proceedings Article

In: International Conference on Computer Vision 2021, 2019.

Links | BibTeX

266.

Lakhmiri, Dounia; Digabel, Sébastien Le; Tribes, Christophe

HyperNOMAD - Hyperparameter optimization of deep neural networks using mesh adaptive direct search Technical Report

2019.

Links | BibTeX

265.

Behjat, Amir; Chidambaran, Sharat; Chowdhury, Souma

Adaptive Genomic Evolution of Neural Network Topologies (AGENT) for State-to-Action Mapping in Autonomous Agents Proceedings Article

In: pp. 9638-9644, 2019.

Links | BibTeX

264.

Cheng, Hsin-Pai; Zhang, Tunhou; Yang, Yukun; Yan, Feng; Li, Shiyu; Teague, Harris; Li, Hai Helen; Chen, Yiran

SwiftNet - Using Graph Propagation as Meta-knowledge to Search Highly Representative Neural Architectures Technical Report

2019.

Links | BibTeX

263.

Borsos, Zalán; Khorlin, Andrey; Gesmundo, Andrea

Transfer NAS - Knowledge Transfer between Search Spaces with Transformer Agents Technical Report

2019.

Links | BibTeX

262.

Nayman, Niv; Noy, Asaf; Ridnik, Tal; Friedman, Itamar; Jin, Rong; Zelnik-Manor, Lihi

XNAS - Neural Architecture Search with Expert Advice Proceedings Article

In: pp. 1975-1985, 2019.

Links | BibTeX

261.

Singh, Prabhant; Jacobs, Tobias; Nicolas, Sebastien; Schmidt, Mischa

A Study of the Learning Progress in Neural Architecture Search Techniques Technical Report

2019.

Links | BibTeX

260.

Srinivas, Sai Vineeth Kalluru; Nair, Harideep; Vidyasagar, Vinay

Hardware Aware Neural Network Architectures using FbNet Technical Report

2019.

Links | BibTeX

259.

Wang, Linnan; Xie, Saining; Li, Teng; Fonseca, Rodrigo; Tian, Yuandong

Sample-Efficient Neural Architecture Search by Learning Action Space Technical Report

2019.

Links | BibTeX

258.

Cheng, Hsin-Pai; Zhang, Tunhou; Yang, Yukun; Yan, Feng; Li, Shiyu; Teague, Harris; Li, Hai Helen; Chen, Yiran

SwiftNet - Using Graph Propagation as Meta-knowledge to Search Highly Representative Neural Architectures Technical Report

2019.

Links | BibTeX

257.

Yu, Qihang; Yang, Dong; Roth, Holger; Bai, Yutong; Zhang, Yixiao; Yuille, Alan L; Xu, Daguang

C2FNAS: Coarse-to-Fine Neural Architecture Search for 3D Medical Image Segmentation Technical Report

2019.

Links | BibTeX

256.

Pasunuru, Ramakanth; Bansal, Mohit

Continual and Multi-Task Architecture Search Proceedings Article

In: pp. 1911-1922, 2019.

Links | BibTeX

255.

Cho, Minsu; Soltani, Mohammadreza; Hegde, Chinmay

One-Shot Neural Architecture Search via Compressive Sensing Technical Report

2019.

Links | BibTeX

254.

Zhu, Zhuotun; Liu, Chenxi; Yang, Dong; Yuille, Alan L; Xu, Daguang

V-NAS - Neural Architecture Search for Volumetric Medical Image Segmentation Proceedings Article

In: pp. 240-248, 2019.

Links | BibTeX

253.

An, Jie; Xiong, Haoyi; Ma, Jinwen; Luo, Jiebo; Huan, Jun

StyleNAS - An Empirical Study of Neural Architecture Search to Uncover Surprisingly Fast End-to-End Universal Style Transfer Networks Technical Report

2019.

Links | BibTeX

252.

Hu, Hanzhang; Langford, John; Caruana, Rich; Mukherjee, Saurajit; Horvitz, Eric; Dey, Debadeepta

Efficient Forward Architecture Search Proceedings Article

In: pp. 10122-10131, 2019.

Links | BibTeX

3651 entries « 68 of 74 »