AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4193 entries « 76 of 84 »

2020

443.

Zhong, Guoqiang; Jiao, Wencong; Gao, Wei; Huang, Kaizhu

Automatic Design of Deep Networks with Neural Blocks Journal Article

In: vol. 12, no. 1, pp. 1-12, 2020.

Links | BibTeX

442.

Chu, Xiangxiang; Zhang, Bo; Li, Jixiang; Li, Qingyuan; Xu, Ruijun

SCARLET-NAS: Bridging the gap between Stability and Scalability in Weight-sharing Neural Architecture Search Technical Report

2020.

Links | BibTeX

441.

Ning, Xuefei; Zheng, Yin; Zhao, Tianchen; Wang, Yu; Yang, Huazhong

A Generic Graph-based Neural Architecture Encoding Scheme for Predictor-based NAS Technical Report

2020.

Links | BibTeX

440.

Chu, Xiangxiang; Zhang, Bo; Xu, Ruijun

MoGA - Searching Beyond Mobilenetv3 Proceedings Article

In: pp. 4042-4046, 2020.

Links | BibTeX

439.

Wang, Bin; Xue, Bing; Zhang, Mengjie

Particle Swarm optimisation for Evolving Deep Neural Networks for Image Classification by Evolving and Stacking Transferable Blocks Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

438.

Calisto, Maria Baldeon G; Lai-Yuen, Susana K

Self-adaptive 2D-3D ensemble of fully convolutional networks for medical image segmentation Proceedings Article

In: pp. 113131W, 2020.

Links | BibTeX

437.

Jiang, Weiwen; Yang, Lei; Sha, Edwin Hsing-Mean; Zhuge, Qingfeng; Gu, Shouzhen; Dasgupta, Sakyasingha; Shi, Yiyu; Hu, Jingtong

Hardware/Software Co-Exploration of Neural Architectures Journal Article

In: vol. 39, no. 12, pp. 4805-4815, 2020.

Links | BibTeX

436.

Jiang, Weiwen; Yang, Lei; Sha, Edwin Hsing-Mean; Zhuge, Qingfeng; Gu, Shouzhen; Dasgupta, Sakyasingha; Shi, Yiyu; Hu, Jingtong

Hardware/Software Co-Exploration of Neural Architectures Journal Article

In: vol. 39, no. 12, pp. 4805-4815, 2020.

Links | BibTeX

435.

Kotyan, Shashank; Vargas, Danilo Vasconcellos

Towards evolving robust neural architectures to defend from adversarial attacks Proceedings Article

In: pp. 135-136, 2020.

Links | BibTeX

434.

Sun, Yanan; Wang, Handing; Xue, Bing; Jin, Yaochu; Yen, Gary G; Zhang, Mengjie

Surrogate-Assisted Evolutionary Deep Learning Using an End-to-End Random Forest-Based Performance Predictor Journal Article

In: vol. 24, no. 2, pp. 350-364, 2020.

Links | BibTeX

433.

Fang, Jiemin; Sun, Yuzhu; Zhang, Qian; Li, Yuan; Liu, Wenyu; Wang, Xinggang

Densely Connected Search Space for More Flexible Neural Architecture Search Proceedings Article

In: pp. 10625-10634, 2020.

Links | BibTeX

432.

Zhou, Yizhou; Sun, Xiaoyan; Luo, Chong; Zha, Zheng-Jun; Zeng, Wenjun

Posterior-Guided Neural Architecture Search Proceedings Article

In: pp. 6973-6980, 2020.

Links | BibTeX

431.

Wen, Wei; Yan, Feng; Chen, Yiran; Li, Hai

AutoGrow - Automatic Layer Growing in Deep Convolutional Networks Proceedings Article

In: pp. 833-841, 2020.

Links | BibTeX

430.

Ryoo, Michael S; Piergiovanni, A J; Tan, Mingxing; Angelova, Anelia

AssembleNet - Searching for Multi-Stream Neural Connectivity in Video Architectures Proceedings Article

In: 2020.

Links | BibTeX

429.

Nguyen, Kien; Fookes, Clinton; Sridharan, Sridha

Constrained Design of Deep Iris Networks Journal Article

In: vol. 29, pp. 7166-7175, 2020.

Links | BibTeX

428.

Sun, Yanan; Xue, Bing; Zhang, Mengjie; Yen, Gary G

Evolving Deep Convolutional Neural Networks for Image Classification Journal Article

In: vol. 24, no. 2, pp. 394-407, 2020.

Links | BibTeX

427.

Calisto, Maria Baldeon G; Lai-Yuen, Susana K

AdaResU-Net - Multiobjective adaptive convolutional neural network for medical image segmentation Journal Article

In: vol. 392, pp. 325-340, 2020.

Links | BibTeX

426.

Zhu, Ning; Yu, Zekuan; Kou, Caixia

A New Deep Neural Architecture Search Pipeline for Face Recognition Journal Article

In: vol. 8, pp. 91303-91310, 2020.

Links | BibTeX

425.

Cassimon, Thomas; Vanneste, Simon; Bosmans, Stig; Mercelis, Siegfried; Hellinckx, Peter

Designing resource-constrained neural networks using neural architecture search targeting embedded devices Journal Article

In: vol. 12, pp. 100234, 2020.

Links | BibTeX

424.

Noy, Asaf; Nayman, Niv; Ridnik, Tal; Zamir, Nadav; Doveh, Sivan; Friedman, Itamar; Giryes, Raja; Zelnik, Lihi

ASAP - Architecture Search, Anneal and Prune Proceedings Article

In: pp. 493-503, 2020.

Links | BibTeX

423.

Nekrasov, Vladimir; Chen, Hao; Shen, Chunhua; Reid, Ian D

Architecture Search of Dynamic Cells for Semantic Video Segmentation Proceedings Article

In: pp. 1959-1968, 2020.

Links | BibTeX

422.

Nekrasov, Vladimir; Shen, Chunhua; Reid, Ian D

Template-Based Automatic Search of Compact Semantic Segmentation Architectures Proceedings Article

In: pp. 1969-1978, 2020.

Links | BibTeX

421.

Guo, Zichao; Zhang, Xiangyu; Mu, Haoyuan; Heng, Wen; Liu, Zechun; Wei, Yichen; Sun, Jian

Single Path One-Shot Neural Architecture Search with Uniform Sampling Proceedings Article

In: pp. 544-560, 2020.

Links | BibTeX

420.

Suganuma, Masanori; Kobayashi, Masayuki; Shirakawa, Shinichi; Nagao, Tomoharu

Evolution of Deep Convolutional Neural Networks Using Cartesian Genetic Programming Journal Article

In: vol. 28, no. 1, pp. 141-163, 2020.

Links | BibTeX

419.

Kandasamy, Kirthevasan; Vysyaraju, Karun Raju; Neiswanger, Willie; Paria, Biswajit; Collins, Christopher R; Schneider, Jeff; Póczos, Barnabás; Xing, Eric P

Tuning Hyperparameters without Grad Students - Scalable and Robust Bayesian Optimisation with Dragonfly Journal Article

In: vol. 21, pp. 81:1-81:27, 2020.

Links | BibTeX

418.

Yu, Kaicheng; Sciuto, Christian; Jaggi, Martin; Musat, Claudiu; Salzmann, Mathieu

Evaluating The Search Phase of Neural Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

417.

Yan, Zhicheng; Dai, Xiaoliang; Zhang, Peizhao; Tian, Yuandong; Wu, Bichen; Feiszli, Matt

FP-NAS - Fast Probabilistic Neural Architecture Search Technical Report

2020.

Links | BibTeX

416.

Chu, Xiangxiang; Zhang, Bo; Xu, Ruijun

Multi-objective Reinforced Evolution in Mobile Neural Architecture Search Proceedings Article

In: pp. 99-113, 2020.

Links | BibTeX

415.

Cheng, An-Chieh; Lin, Chieh Hubert; Juan, Da-Cheng; Wei, Wei; Sun, Min

InstaNAS - Instance-Aware Neural Architecture Search Proceedings Article

In: pp. 3577-3584, 2020.

Links | BibTeX

414.

Sun, Yanan; Xue, Bing; Zhang, Mengjie; Yen, Gary G; Lv, Jiancheng

Automatically Designing CNN Architectures Using the Genetic Algorithm for Image Classification Journal Article

In: vol. 50, no. 9, pp. 3840-3854, 2020.

Links | BibTeX

413.

Huang, Sian-Yao; Chu, Wei-Ta

PONAS - Progressive One-shot Neural Architecture Search for Very Efficient Deployment Technical Report

2020.

Links | BibTeX

412.

Chu, Xiangxiang; Zhou, Tianbao; Zhang, Bo; Li, Jixiang

Fair DARTS - Eliminating Unfair Advantages in Differentiable Architecture Search Proceedings Article

In: pp. 465-480, 2020.

Links | BibTeX

411.

Wang, Linnan; Zhao, Yiyang; Jinnai, Yuu; Tian, Yuandong; Fonseca, Rodrigo

Neural Architecture Search Using Deep Neural Networks and Monte Carlo Tree Search Proceedings Article

In: pp. 9983-9991, 2020.

Links | BibTeX

410.

Wei, Jiahong; Fan, Zhun

Genetic U-Net - Automatically Designing Lightweight U-shaped CNN Architectures Using the Genetic Algorithm for Retinal Vessel Segmentation Technical Report

2020.

Links | BibTeX

409.

Flynn, Deanna; Furlong, Michael P; Coltin, Brian

Search Tree Pruning for Progressive Neural Architecture Search (Student Abstract) Proceedings Article

In: pp. 13783-13784, 2020.

Links | BibTeX

408.

Herzog, Sebastian; Tetzlaff, Christian; Wörgötter, Florentin

Evolving artificial neural networks with feedback Journal Article

In: vol. 123, pp. 153-162, 2020.

Links | BibTeX

407.

Damian, A I; Piciu, L; Tapus, N

A view on automated neural graph topology generation and a viable direction of innovation Proceedings Article

In: 2020 19th RoEduNet Conference: Networking in Education and Research (RoEduNet), pp. 1-7, 2020.

Links | BibTeX

406.

Hao, Lu; Han, Hu

NAS-HR: search of neural architecture for heart-rate estimation from face videos Proceedings Article

In: 2020.

Links | BibTeX

405.

Wang, Ning; Gao, Yang; Chen, Hao; Wang, Peng; Tian, Zhi; Shen, Chunhua; Zhang, Yanning

NAS-FCOS: Fast Neural Architecture Search for Object Detection Proceedings Article

In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, pp. 11940–11948, IEEE, 2020.

Links | BibTeX

404.

Chen, X; Sun, Y; Zhang, M; Peng, D

Evolving Deep Convolutional Variational Autoencoders for Image Classification Journal Article

In: IEEE Transactions on Evolutionary Computation, pp. 1-1, 2020.

Abstract | Links | BibTeX

403.

Pretraining Neural Architecture Search Controllers with Locality-based Self-Supervised Learning Proceedings Article

In: NeurIPS 2020 Workshop: Self-Supervised Learning - Theory and Practice, 2020.

Abstract | Links | BibTeX

402.

Zhang, Yikang; Zhang, Jian; Zhong, Zhao

AutoBSS: An Efficient Algorithm for Block Stacking Style Search Proceedings Article

In: Larochelle, Hugo; Ranzato, MarcÁurelio; Hadsell, Raia; -, Maria; -, Hsuan (Ed.): Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual, 2020.

Links | BibTeX

401.

Wan, Y; Zhong, Y; Ma, A; Wang, J; Feng, R

RSSM-Net: Remote Sensing Image Scene Classification Based on Multi-Objective Neural Architecture Search Proceedings Article

In: IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium, pp. 1369-1372, 2020.

Links | BibTeX

400.

Borgohain, Satya; Kowadlo, Gideon; Rawlinson, David; Bergmeir, Christoph; Loo, Kok; Rangarajan, Harivallabha; Kuhlmann, Levin

Self-organising Neural Network Hierarchy Proceedings Article

In: Gallagher, Marcus; Moustafa, Nour; Lakshika, Erandi (Ed.): AI 2020: Advances in Artificial Intelligence - 33rd Australasian Joint Conference, AI 2020, Canberra, ACT, Australia, November 29-30, 2020, Proceedings, pp. 359–370, Springer, 2020.

Links | BibTeX

399.

Zhu, Baozhou; Al-Ars, Zaid; Hofstee, H. Peter

NASB: Neural Architecture Search for Binary Convolutional Neural Networks Proceedings Article

In: 2020 International Joint Conference on Neural Networks, IJCNN 2020, Glasgow, United Kingdom, July 19-24, 2020, pp. 1–8, IEEE, 2020.

Links | BibTeX

2019

398.

Mazurczyk, Wojciech; Wendzel, Steffen; Chourib, Mehdi; Keller, Jörg

Countering adaptive network covert communication with dynamic wardens Technical Report

2019, ISSN: 0167-739X.

Links | BibTeX

397.

Such, Felipe Petroski; Rawal, Aditya; Lehman, Joel; Stanley, Kenneth O; Clune, Jeff

Generative Teaching Networks: Accelerating Neural Architecture Search by Learning to Generate Synthetic Training Data Technical Report

2019.

Links | BibTeX

396.

Beery, Sara; Wu, Guanhang; Rathod, Vivek; Votel, Ronny; Huang, Jonathan

Context R-CNN: Long Term Temporal Context for Per-Camera Object Detection Technical Report

2019.

Links | BibTeX

395.

Musil, Josef; Knir, Jakub; Vitsas, Athanasios; Gallou, Irene

Towards Sustainable Architecture: 3D Convolutional Neural Networks for Computational Fluid Dynamics Simulation and Reverse DesignWorkflow Technical Report

2019.

Links | BibTeX

394.

Hawkins, Cole; Zhang, Zheng

Bayesian Tensorized Neural Networks with Automatic Rank Selection Technical Report

2019.

Links | BibTeX

4193 entries « 76 of 84 »