AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3425 entries « 50 of 69 »

2020

975.

Fu, Yonggan; Yu, Zhongzhi; Zhang, Yongan; Lin, Yingyan

Auto-Agent-Distiller - Towards Efficient Deep Reinforcement Learning Agents via Neural Architecture Search Technical Report

2020.

Links | BibTeX

974.

Zhang, Haokui; Li, Ying; Gong, Chengrong; Chen, Hao; Bai, Zongwen; Shen, Chunhua

Memory-Efficient Hierarchical Neural Architecture Search for Image Restoration Technical Report

2020.

Links | BibTeX

973.

Hosseini, Ramtin; Xie, Pengtao

Learning by Self-Explanation, with Application to Neural Architecture Search Technical Report

2020.

Links | BibTeX

972.

Du, Xuefeng; Xie, Pengtao

Small-Group Learning, with Application to Neural Architecture Search Technical Report

2020.

Links | BibTeX

971.

Kim, Heewon; Baik, Sungyong; Choi, Myungsub; Choi, Janghoon; Lee, Kyoung Mu

Searching for Controllable Image Restoration Networks Technical Report

2020.

Links | BibTeX

970.

Hou, Pengfei; Jin, Ying

Single-level Optimization For Differential Architecture Search Technical Report

2020.

Links | BibTeX

969.

Lankford, Séamus; Grimes, Diarmuid

Neural Architecture Search using Particle Swarm and Ant Colony Optimization Proceedings Article

In: pp. 229-240, 2020.

Links | BibTeX

968.

Ning, Xuefei; Tang, Changcheng; Li, Wenshuo; Yang, Songyi; Zhao, Tianchen; Zhang, Niansong; Lu, Tianyi; Liang, Shuang; Yang, Huazhong; Wang, Yu

aw_nas: A Modularized and Extensible NAS framework Technical Report

2020.

Links | BibTeX

967.

Luo, Xiangzhong; Liu, Di; Kong, Hao; Liu, Weichen

EdgeNAS - Discovering Efficient Neural Architectures for Edge Systems Proceedings Article

In: pp. 288-295, 2020.

Links | BibTeX

966.

Fan, Hongxiang; Ferianc, Martin; Liu, Shuanglong; Que, Zhiqiang; Niu, Xinyu; Luk, Wayne

Optimizing FPGA-Based CNN Accelerator Using Differentiable Neural Architecture Search Proceedings Article

In: pp. 465-468, 2020.

Links | BibTeX

965.

Peter, David; Roth, Wolfgang; Pernkopf, Franz

Resource-efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization Technical Report

2020.

Links | BibTeX

964.

Rakhshani, Hojjat; Idoumghar, Lhassane; Ghambari, Soheila; Lepagnot, Julien; Brévilliers, Mathieu

On the performance of deep learning for numerical optimization - an application to protein structure prediction Technical Report

2020.

Links | BibTeX

963.

Yuan, Gonglin; Xue, Bing; Zhang, Mengjie

A Graph-Based Approach to Automatic Convolutional Neural Network Construction for Image Classification Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

962.

Zhu, Xinxin; Wang, Weining; Guo, Longteng; Liu, Jing

AutoCaption - Image Captioning with Neural Architecture Search Technical Report

2020.

Links | BibTeX

961.

Kashima, Taiga; Yamada, Yoshihiro; Saito, Shunta

Joint Search of Data Augmentation Policies and Network Architectures Technical Report

2020.

Links | BibTeX

960.

Wang, Chunnan; Wang, Hongzhi; Feng, Guosheng; Geng, Fei

Multi-Objective Neural Architecture Search Based on Diverse Structures and Adaptive Recommendation Technical Report

2020.

Links | BibTeX

959.

Moons, Bert; Noorzad, Parham; Skliar, Andrii; Mariani, Giovanni; Mehta, Dushyant; Lott, Chris; Blankevoort, Tijmen

Distilling Optimal Neural Networks - Rapid Search in Diverse Spaces Technical Report

2020.

Links | BibTeX

958.

Zhang, Wenqiang; Fang, Jiemin; Wang, Xinggang; Liu, Wenyu

EfficientPose - Efficient Human Pose Estimation with Neural Architecture Search Technical Report

2020.

Links | BibTeX

957.

Awad, Noor H; Mallik, Neeratyoy; Hutter, Frank

Differential Evolution for Neural Architecture Search Technical Report

2020.

Links | BibTeX

956.

Sato, Rei; Sakuma, Jun; Akimoto, Youhei

AdvantageNAS - Efficient Neural Architecture Search with Credit Assignment Technical Report

2020.

Links | BibTeX

955.

Gallo, Ignazio; Magistrali, Gabriele; Landro, Nicola; Grassa, Riccardo La

Improving the Efficient Neural Architecture Search via Rewarding Modifications Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

954.

Kumar, Vidhur; Szidon, Andrew

Efficient Incorporation of Multiple Latency Targets in the Once-For-All Network Technical Report

2020.

Links | BibTeX

953.

Steuler, Jan Linus; Beck, Markus; Passow, Benjamin N; Guckert, Michael

Optimizing the Energy Consumption of Neural Networks Proceedings Article

In: pp. 2312-2319, 2020.

Links | BibTeX

952.

Kobayashi, Masayuki; Arai, Satoshi; Nagao, Tomoharu

Evolutionary Generative Contribution Mappings Proceedings Article

In: pp. 1657-1664, 2020.

Links | BibTeX

951.

Liu, Risheng; Ma, Long; Zhang, Jiaao; Fan, Xin; Luo, Zhongxuan

Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancement Technical Report

2020.

Links | BibTeX

950.

Li, Zhaoqun; Wang, Hongren; Li, Jinxing

Auto-MVCNN - Neural Architecture Search for Multi-view 3D Shape Recognition Technical Report

2020.

Links | BibTeX

949.

Xie, Pengtao; Du, Xuefeng; Ban, Hao

Skillearn: Machine Learning Inspired by Humans' Learning Skills Technical Report

2020.

Links | BibTeX

948.

Pan, Jingyu; Chang, Chen-Chia; Zhang, Tunhou; Xie, Zhiyao; Hu, Jiang; Qi, Weiyi; Lin, Chung-Wei; Liang, Rongjian; Mitra, Joydeep; Fallon, Elias; Chen, Yiran

Automatic Routability Predictor Development Using Neural Architecture Search Technical Report

2020.

Links | BibTeX

947.

Garcia-Valencia, Sebastian; Betancourt, Alejandro; Pulido, Juan Guillermo Lalinde

Sequence Generation using Deep Recurrent Networks and Embeddings - A study case in music Technical Report

2020.

Links | BibTeX

946.

Wang, Qifei; Ke, Junjie; Greaves, Joshua; Chu, Grace; Bender, Gabriel; Sbaiz, Luciano; Go, Alec; Howard, Andrew; Yang, Feng; Yang, Ming-Hsuan; Gilbert, Jeff; Milanfar, Peyman

Multi-path Neural Networks for On-device Multi-domain Visual Classification Technical Report

2020.

Links | BibTeX

945.

d'Avila Garcez, Artur; Lamb, Luis C

Neurosymbolic AI: The 3rd Wave Technical Report

2020.

Links | BibTeX

944.

Cheng, Hsin-Pai; Liang, Feng; Li, Meng; Cheng, Bowen; Yan, Feng; Li, Hai; Chandra, Vikas; Chen, Yiran

ScaleNAS - One-Shot Learning of Scale-Aware Representations for Visual Recognition Technical Report

2020.

Links | BibTeX

943.

Li, Zhengang; Yuan, Geng; Niu, Wei; Li, Yanyu; Zhao, Pu; Cai, Yuxuan; Shen, Xuan; Zhan, Zheng; Kong, Zhenglun; Jin, Qing; Chen, Zhiyu; Liu, Sijia; Yang, Kaiyuan; Ren, Bin; Wang, Yanzhi; Lin, Xue

67ms on Mobile with over 78% ImageNet Accuracy - Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration Technical Report

2020.

Links | BibTeX

942.

Zhang, Haoyu; Jin, Yaochu; Cheng, Ran; Hao, Kuangrong

Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search Technical Report

2020.

Links | BibTeX

941.

Zhao, Z; -e Zhang, G; Jiang, M; Feng, L; Tan, K C

EDNAS: An Efficient Neural Architecture Design based on Distribution Estimation Technical Report

2020.

Links | BibTeX

940.

Awad, Noor; Mallik, Neeratyoy; Hutter, Frank

Differential Evolution for Neural Architecture Search Technical Report

2020.

Links | BibTeX

939.

Mazyavkina, Nina; Moustafa, S; Trofimov, Ilya; Burnaev, Evgeniy

Optimizing the Neural Architecture of Reinforcement Learning Agents Technical Report

2020.

Links | BibTeX

938.

Fan, Y; Tang, X; Zhou, G; Shen, J

EfficientAutoGAN: Predicting the rewards in reinforcement-based neural architecture search for Generative Adversarial Networks Technical Report

2020.

Links | BibTeX

937.

Ma, Benteng; Zhang, Jing; Xia, Yong; Tao, Dacheng

Inter-layer Transition in Neural Architecture Search Technical Report

2020.

Links | BibTeX

936.

Hu, Shengran; Cheng, Ran; He, Cheng; Lu, Zhichao

Multi-objective Neural Architecture Search with Almost No Training Technical Report

2020.

Links | BibTeX

935.

Kyriakides, George; Margaritis, Konstantinos G

NORD - A python framework for Neural Architecture Search Technical Report

2020.

Links | BibTeX

934.

Liang, Yi-Chuan; Liao, Ying-Chiao; Lin, Chen-Ching; Hung, Shih-Hao

Toward Fast Platform-Aware Neural Architecture Search for FPGA-Accelerated Edge AI Applications Proceedings Article

In: pp. 219-225, 2020.

Links | BibTeX

933.

Chen, Hanlin; Zhang, Baochang; Xue, Song; Gong, Xuan; Liu, Hong; Ji, Rongrong; Doermann, David S

Anti-bandit Neural Architecture Search for Model Defense Proceedings Article

In: pp. 70-85, 2020.

Links | BibTeX

932.

Borgohain, Satya; Kowadlo, Gideon; Rawlinson, David; Bergmeir, Christoph; Loo, Kok; Rangarajan, Harivallabha; Kuhlmann, Levin

Self-organising Neural Network Hierarchy Proceedings Article

In: pp. 359-370, 2020.

Links | BibTeX

931.

Mauch, Lukas; Tiedemann, Stephen; García, Javier Alonso; Cong, Bac Nguyen; Yoshiyama, Kazuki; Cardinaux, Fabien; Kemp, Thomas

Efficient Sampling for Predictor-Based Neural Architecture Search Technical Report

2020.

Links | BibTeX

930.

Wang, Xiaoxing; Chu, Xiangxiang; Fan, Yuda; Zhang, Zhexi; Wei, Xiaolin; Yan, Junchi; Yang, Xiaokang

ROME - Robustifying Memory-Efficient NAS via Topology Disentanglement and Gradients Accumulation Technical Report

2020.

Links | BibTeX

929.

Li, Xudong; Hu, Yang; Zheng, Jianhua; Li, Mingtao

Neural Architecture Search For Fault Diagnosis Technical Report

2020.

Links | BibTeX

928.

Yan, Zhicheng; Dai, Xiaoliang; Zhang, Peizhao; Tian, Yuandong; Wu, Bichen; Feiszli, Matt

FP-NAS - Fast Probabilistic Neural Architecture Search Technical Report

2020.

Links | BibTeX

927.

Ci, Yuanzheng; Lin, Chen; Sun, Ming; Chen, Boyu; Zhang, Hongwen; Ouyang, Wanli

Evolving Search Space for Neural Architecture Search Technical Report

2020.

Links | BibTeX

926.

ElSaid, AbdElRahman A; Karns, Joshua; Lyu, Zimeng; Ororbia, Alexander; Desell, Travis

Continuous Ant-Based Neural Topology Search Technical Report

2020.

Links | BibTeX

3425 entries « 50 of 69 »