AutoML.org

Freiburg-Hannover

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


1646 entries « 29 of 33 »

2019

246.

Balaprakash, Prasanna; Egele, Romain; Salim, Misha; Wild, Stefan M; Vishwanath, Venkatram; Xia, Fangfang; Brettin, Tom; Stevens, Rick

Scalable reinforcement-learning-based neural architecture search for cancer deep learning research Inproceedings

In: pp. 37:1-37:33, 2019.

Links | BibTeX

245.

Sun, Li; Yu, Xiaoyi; Wang, Liuan; Sun, Jun; Inakoshi, Hiroya; Kobayashi, Ken; Kobashi, Hiromichi

Automatic Neural Network Search Method for Open Set Recognition Inproceedings

In: pp. 4090-4094, 2019.

Links | BibTeX

244.

Yan, Shen; Fang, Biyi; Zhang, Faen; Zheng, Yu; Zeng, Xiao; Zhang, Mi; Xu, Hui

HM-NAS - Efficient Neural Architecture Search via Hierarchical Masking Inproceedings

In: pp. 1942-1950, 2019.

Links | BibTeX

243.

Shriver, David; Xu, Dong; Elbaum, Sebastian G; Dwyer, Matthew B

Refactoring Neural Networks for Verification Technical Report

, 2019.

Links | BibTeX

242.

Zhou, Tianbao; Weng, Yu; Yang, Guosheng

CNASV - A Convolutional Neural Architecture Search-Train Prototype for Computer Vision Task Inproceedings

In: pp. 380-393, 2019.

Links | BibTeX

241.

Zhang, Zhaoyang; Li, Jingyu; Shao, Wenqi; Peng, Zhanglin; Zhang, Ruimao; Wang, Xiaogang; Luo, Ping

Differentiable Learning-to-Group Channels via Groupable Convolutional Neural Networks Inproceedings

In: pp. 3541-3550, 2019.

Links | BibTeX

240.

Irwin-Harris, William; Sun, Yanan; Xue, Bing; Zhang, Mengjie

A Graph-Based Encoding for Evolutionary Convolutional Neural Network Architecture Design Inproceedings

In: pp. 546-553, 2019.

Links | BibTeX

239.

Verma, Mudit; Sinha, Pradyumna; Goyal, Karan; Verma, Apoorva; Susan, Seba

A Novel Framework for Neural Architecture Search in the Hill Climbing Domain Inproceedings

In: pp. 1-8, 2019.

Links | BibTeX

238.

Tian, Haiman; Chen, Shu-Ching; Shyu, Mei-Ling; Rubin, Stuart H

Automated Neural Network Construction with Similarity Sensitive Evolutionary Algorithms Inproceedings

In: pp. 283-290, 2019.

Links | BibTeX

237.

Gong, Xinyu; Chang, Shiyu; Jiang, Yifan; Wang, Zhangyang

AutoGAN - Neural Architecture Search for Generative Adversarial Networks Inproceedings

In: pp. 3223-3233, 2019.

Links | BibTeX

236.

Yousefzadeh, Roozbeh; O'Leary, Dianne P

Refining the Structure of Neural Networks Using Matrix Conditioning Technical Report

, 2019.

Links | BibTeX

235.

Shaw, Albert E; Hunter, Daniel; Landola, Forrest; Sidhu, Sammy

SqueezeNAS - Fast Neural Architecture Search for Faster Semantic Segmentation Inproceedings

In: pp. 2014-2024, 2019.

Links | BibTeX

234.

Wang, Bin; Sun, Yanan; Xue, Bing; Zhang, Mengjie

Evolving deep neural networks by multi-objective particle swarm optimization for image classification Inproceedings

In: pp. 490-498, 2019.

Links | BibTeX

233.

Liu, Peiye; Wu, Bo; Ma, Huadong; Chundi, Pavan Kumar; Seok, Mingoo

MemNet - Memory-Efficiency Guided Neural Architecture Search with Augment-Trim learning Technical Report

, 2019.

Links | BibTeX

232.

Zhang, Miao; Li, Huiqi; Pan, Shirui; Liu, Taoping; Su, Steven W

Efficient Novelty-Driven Neural Architecture Search Technical Report

, 2019.

Links | BibTeX

231.

Xu, Yuhui; Xie, Lingxi; Zhang, Xiaopeng; Chen, Xin; Qi, Guo-Jun; Tian, Qi; Xiong, Hongkai

PC-DARTS - Partial Channel Connections for Memory-Efficient Differentiable Architecture Search Technical Report

, 2019.

Links | BibTeX

230.

Zhou, Yanqi; Wang, Peng

EPNAS - Efficient Progressive Neural Architecture Search Inproceedings

In: pp. 71, 2019.

Links | BibTeX

229.

Peng, Wei; Hong, Xiaopeng; Zhao, Guoying

Video Action Recognition Via Neural Architecture Searching Inproceedings

In: pp. 11-15, 2019.

Links | BibTeX

228.

Zhang, Xinyi; Jiang, Weiwen; Shi, Yiyu; Hu, Jingtong

When Neural Architecture Search Meets Hardware Implementation - from Hardware Awareness to Co-Design Inproceedings

In: pp. 25-30, 2019.

Links | BibTeX

227.

Jaâfra, Yesmina; Laurent, Jean Luc; Deruyver, Aline; Naceur, Mohamed Saber

Reinforcement learning for neural architecture search - A review Journal Article

In: 89 , pp. 57-66, 2019.

Links | BibTeX

226.

Li, Yaoman; King, Irwin

Architecture Search for Image Inpainting Inproceedings

In: pp. 106-115, 2019.

Links | BibTeX

225.

Märtens, Marcus; Izzo, Dario

Neural network architecture search with differentiable cartesian genetic programming for regression Inproceedings

In: pp. 181-182, 2019.

Links | BibTeX

224.

Chu, Xiangxiang; Zhang, Bo; Xu, Ruijun; Li, Jixiang

FairNAS - Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search Inproceedings

In: International Conference on Computer Vision 2021, 2019.

Links | BibTeX

223.

Lakhmiri, Dounia; Digabel, Sébastien Le; Tribes, Christophe

HyperNOMAD - Hyperparameter optimization of deep neural networks using mesh adaptive direct search Technical Report

, 2019.

Links | BibTeX

222.

Behjat, Amir; Chidambaran, Sharat; Chowdhury, Souma

Adaptive Genomic Evolution of Neural Network Topologies (AGENT) for State-to-Action Mapping in Autonomous Agents Inproceedings

In: pp. 9638-9644, 2019.

Links | BibTeX

221.

Cheng, Hsin-Pai; Zhang, Tunhou; Yang, Yukun; Yan, Feng; Li, Shiyu; Teague, Harris; Li, Hai Helen; Chen, Yiran

SwiftNet - Using Graph Propagation as Meta-knowledge to Search Highly Representative Neural Architectures Technical Report

, 2019.

Links | BibTeX

220.

Borsos, Zalán; Khorlin, Andrey; Gesmundo, Andrea

Transfer NAS - Knowledge Transfer between Search Spaces with Transformer Agents Technical Report

, 2019.

Links | BibTeX

219.

Nayman, Niv; Noy, Asaf; Ridnik, Tal; Friedman, Itamar; Jin, Rong; Zelnik-Manor, Lihi

XNAS - Neural Architecture Search with Expert Advice Inproceedings

In: pp. 1975-1985, 2019.

Links | BibTeX

218.

Singh, Prabhant; Jacobs, Tobias; Nicolas, Sebastien; Schmidt, Mischa

A Study of the Learning Progress in Neural Architecture Search Techniques Technical Report

, 2019.

Links | BibTeX

217.

Srinivas, Sai Vineeth Kalluru; Nair, Harideep; Vidyasagar, Vinay

Hardware Aware Neural Network Architectures using FbNet Technical Report

, 2019.

Links | BibTeX

216.

Wang, Linnan; Xie, Saining; Li, Teng; Fonseca, Rodrigo; Tian, Yuandong

Sample-Efficient Neural Architecture Search by Learning Action Space Technical Report

, 2019.

Links | BibTeX

215.

Cheng, Hsin-Pai; Zhang, Tunhou; Yang, Yukun; Yan, Feng; Li, Shiyu; Teague, Harris; Li, Hai Helen; Chen, Yiran

SwiftNet - Using Graph Propagation as Meta-knowledge to Search Highly Representative Neural Architectures Technical Report

, 2019.

Links | BibTeX

214.

Yu, Qihang; Yang, Dong; Roth, Holger; Bai, Yutong; Zhang, Yixiao; Yuille, Alan L; Xu, Daguang

C2FNAS: Coarse-to-Fine Neural Architecture Search for 3D Medical Image Segmentation Technical Report

2019.

Links | BibTeX

213.

Pasunuru, Ramakanth; Bansal, Mohit

Continual and Multi-Task Architecture Search Inproceedings

In: pp. 1911-1922, 2019.

Links | BibTeX

212.

Cho, Minsu; Soltani, Mohammadreza; Hegde, Chinmay

One-Shot Neural Architecture Search via Compressive Sensing Technical Report

2019.

Links | BibTeX

211.

Zhu, Zhuotun; Liu, Chenxi; Yang, Dong; Yuille, Alan L; Xu, Daguang

V-NAS - Neural Architecture Search for Volumetric Medical Image Segmentation Inproceedings

In: pp. 240-248, 2019.

Links | BibTeX

210.

An, Jie; Xiong, Haoyi; Ma, Jinwen; Luo, Jiebo; Huan, Jun

StyleNAS - An Empirical Study of Neural Architecture Search to Uncover Surprisingly Fast End-to-End Universal Style Transfer Networks Technical Report

, 2019.

Links | BibTeX

209.

Hu, Hanzhang; Langford, John; Caruana, Rich; Mukherjee, Saurajit; Horvitz, Eric; Dey, Debadeepta

Efficient Forward Architecture Search Inproceedings

In: pp. 10122-10131, 2019.

Links | BibTeX

208.

Yao, Quanming; Xu, Ju; Tu, Wei-Wei; Zhu, Zhanxing

Differentiable Neural Architecture Search via Proximal Iterations Technical Report

, 2019.

Links | BibTeX

207.

Zheng, Xiawu; Ji, Rongrong; Tang, Lang; Wan, Yan; Zhang, Baochang; Wu, Yongjian; Wu, Yunsheng; Shao, Ling

Dynamic Distribution Pruning for Efficient Network Architecture Search Technical Report

, 2019.

Links | BibTeX

206.

Junior, Francisco Erivaldo Fernandes; Yen, Gary G

Particle swarm optimization of deep neural networks architectures for image classification Journal Article

In: 49 , pp. 62-74, 2019.

Links | BibTeX

205.

Radosavovic, Ilija; Johnson, Justin; Xie, Saining; Lo, Wan-Yen; Dollár, Piotr

On Network Design Spaces for Visual Recognition Inproceedings

In: pp. 1882-1890, 2019.

Links | BibTeX

204.

Tan, Mingxing; Le, Quoc V

EfficientNet - Rethinking Model Scaling for Convolutional Neural Networks Inproceedings

In: pp. 6105-6114, 2019.

Links | BibTeX

203.

Pahuja, Vardaan; Fu, Jie; Chandar, Sarath; Pal, Christopher Joseph

Structure Learning for Neural Module Networks Inproceedings

In: pp. 1-10, 2019.

Links | BibTeX

202.

Fedorov, Igor; Adams, Ryan P; Mattina, Matthew; Whatmough, Paul N

SpArSe - Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers Inproceedings

In: pp. 4978-4990, 2019.

Links | BibTeX

201.

Dong, Xuanyi; Yang, Yi

Network Pruning via Transformable Architecture Search Inproceedings

In: pp. 759-770, 2019.

Links | BibTeX

200.

Cho, Hyunghun; Kim, Yongjin; Lee, Eunjung; Choi, Daeyoung; Lee, Yongjae; Rhee, Wonjong

DEEP-BO for Hyperparameter Optimization of Deep Networks Technical Report

, 2019.

Links | BibTeX

199.

Akimoto, Youhei; Shirakawa, Shinichi; Yoshinari, Nozomu; Uchida, Kento; Saito, Shota; Nishida, Kouhei

Adaptive Stochastic Natural Gradient Method for One-Shot Neural Architecture Search Inproceedings

In: pp. 171-180, 2019.

Links | BibTeX

198.

Zheng, Xiawu; Ji, Rongrong; Tang, Lang; Zhang, Baochang; Liu, Jianzhuang; Tian, Qi

Multinomial Distribution Learning for Effective Neural Architecture Search Inproceedings

In: pp. 1304-1313, 2019.

Links | BibTeX

197.

Zhu, Hui; An, Zhulin; Yang, Chuanguang; Xu, Kaiqiang; Zhao, Erhu; Xu, Yongjun

EENA - Efficient Evolution of Neural Architecture Inproceedings

In: pp. 1891-1899, 2019.

Links | BibTeX

1646 entries « 29 of 33 »