AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4488 entries « 71 of 90 »

2020

988.

Hosseini, Ramtin; Xie, Pengtao

Learning by Self-Explanation, with Application to Neural Architecture Search Technical Report

2020.

Links | BibTeX

987.

Du, Xuefeng; Xie, Pengtao

Small-Group Learning, with Application to Neural Architecture Search Technical Report

2020.

Links | BibTeX

986.

Kim, Heewon; Baik, Sungyong; Choi, Myungsub; Choi, Janghoon; Lee, Kyoung Mu

Searching for Controllable Image Restoration Networks Technical Report

2020.

Links | BibTeX

985.

Hou, Pengfei; Jin, Ying

Single-level Optimization For Differential Architecture Search Technical Report

2020.

Links | BibTeX

984.

Lankford, Séamus; Grimes, Diarmuid

Neural Architecture Search using Particle Swarm and Ant Colony Optimization Proceedings Article

In: pp. 229-240, 2020.

Links | BibTeX

983.

Ning, Xuefei; Tang, Changcheng; Li, Wenshuo; Yang, Songyi; Zhao, Tianchen; Zhang, Niansong; Lu, Tianyi; Liang, Shuang; Yang, Huazhong; Wang, Yu

aw_nas: A Modularized and Extensible NAS framework Technical Report

2020.

Links | BibTeX

982.

Luo, Xiangzhong; Liu, Di; Kong, Hao; Liu, Weichen

EdgeNAS - Discovering Efficient Neural Architectures for Edge Systems Proceedings Article

In: pp. 288-295, 2020.

Links | BibTeX

981.

Fan, Hongxiang; Ferianc, Martin; Liu, Shuanglong; Que, Zhiqiang; Niu, Xinyu; Luk, Wayne

Optimizing FPGA-Based CNN Accelerator Using Differentiable Neural Architecture Search Proceedings Article

In: pp. 465-468, 2020.

Links | BibTeX

980.

Peter, David; Roth, Wolfgang; Pernkopf, Franz

Resource-efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization Technical Report

2020.

Links | BibTeX

979.

Rakhshani, Hojjat; Idoumghar, Lhassane; Ghambari, Soheila; Lepagnot, Julien; Brévilliers, Mathieu

On the performance of deep learning for numerical optimization - an application to protein structure prediction Technical Report

2020.

Links | BibTeX

978.

Yuan, Gonglin; Xue, Bing; Zhang, Mengjie

A Graph-Based Approach to Automatic Convolutional Neural Network Construction for Image Classification Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

977.

Zhu, Xinxin; Wang, Weining; Guo, Longteng; Liu, Jing

AutoCaption - Image Captioning with Neural Architecture Search Technical Report

2020.

Links | BibTeX

976.

Kashima, Taiga; Yamada, Yoshihiro; Saito, Shunta

Joint Search of Data Augmentation Policies and Network Architectures Technical Report

2020.

Links | BibTeX

975.

Wang, Chunnan; Wang, Hongzhi; Feng, Guosheng; Geng, Fei

Multi-Objective Neural Architecture Search Based on Diverse Structures and Adaptive Recommendation Technical Report

2020.

Links | BibTeX

974.

Moons, Bert; Noorzad, Parham; Skliar, Andrii; Mariani, Giovanni; Mehta, Dushyant; Lott, Chris; Blankevoort, Tijmen

Distilling Optimal Neural Networks - Rapid Search in Diverse Spaces Technical Report

2020.

Links | BibTeX

973.

Zhang, Wenqiang; Fang, Jiemin; Wang, Xinggang; Liu, Wenyu

EfficientPose - Efficient Human Pose Estimation with Neural Architecture Search Technical Report

2020.

Links | BibTeX

972.

Awad, Noor H; Mallik, Neeratyoy; Hutter, Frank

Differential Evolution for Neural Architecture Search Technical Report

2020.

Links | BibTeX

971.

Sato, Rei; Sakuma, Jun; Akimoto, Youhei

AdvantageNAS - Efficient Neural Architecture Search with Credit Assignment Technical Report

2020.

Links | BibTeX

970.

Gallo, Ignazio; Magistrali, Gabriele; Landro, Nicola; Grassa, Riccardo La

Improving the Efficient Neural Architecture Search via Rewarding Modifications Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

969.

Kumar, Vidhur; Szidon, Andrew

Efficient Incorporation of Multiple Latency Targets in the Once-For-All Network Technical Report

2020.

Links | BibTeX

968.

Steuler, Jan Linus; Beck, Markus; Passow, Benjamin N; Guckert, Michael

Optimizing the Energy Consumption of Neural Networks Proceedings Article

In: pp. 2312-2319, 2020.

Links | BibTeX

967.

Kobayashi, Masayuki; Arai, Satoshi; Nagao, Tomoharu

Evolutionary Generative Contribution Mappings Proceedings Article

In: pp. 1657-1664, 2020.

Links | BibTeX

966.

Liu, Risheng; Ma, Long; Zhang, Jiaao; Fan, Xin; Luo, Zhongxuan

Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancement Technical Report

2020.

Links | BibTeX

965.

Li, Zhaoqun; Wang, Hongren; Li, Jinxing

Auto-MVCNN - Neural Architecture Search for Multi-view 3D Shape Recognition Technical Report

2020.

Links | BibTeX

964.

Xie, Pengtao; Du, Xuefeng; Ban, Hao

Skillearn: Machine Learning Inspired by Humans' Learning Skills Technical Report

2020.

Links | BibTeX

963.

Pan, Jingyu; Chang, Chen-Chia; Zhang, Tunhou; Xie, Zhiyao; Hu, Jiang; Qi, Weiyi; Lin, Chung-Wei; Liang, Rongjian; Mitra, Joydeep; Fallon, Elias; Chen, Yiran

Automatic Routability Predictor Development Using Neural Architecture Search Technical Report

2020.

Links | BibTeX

962.

Garcia-Valencia, Sebastian; Betancourt, Alejandro; Pulido, Juan Guillermo Lalinde

Sequence Generation using Deep Recurrent Networks and Embeddings - A study case in music Technical Report

2020.

Links | BibTeX

961.

Wang, Qifei; Ke, Junjie; Greaves, Joshua; Chu, Grace; Bender, Gabriel; Sbaiz, Luciano; Go, Alec; Howard, Andrew; Yang, Feng; Yang, Ming-Hsuan; Gilbert, Jeff; Milanfar, Peyman

Multi-path Neural Networks for On-device Multi-domain Visual Classification Technical Report

2020.

Links | BibTeX

960.

d'Avila Garcez, Artur; Lamb, Luis C

Neurosymbolic AI: The 3rd Wave Technical Report

2020.

Links | BibTeX

959.

Cheng, Hsin-Pai; Liang, Feng; Li, Meng; Cheng, Bowen; Yan, Feng; Li, Hai; Chandra, Vikas; Chen, Yiran

ScaleNAS - One-Shot Learning of Scale-Aware Representations for Visual Recognition Technical Report

2020.

Links | BibTeX

958.

Li, Zhengang; Yuan, Geng; Niu, Wei; Li, Yanyu; Zhao, Pu; Cai, Yuxuan; Shen, Xuan; Zhan, Zheng; Kong, Zhenglun; Jin, Qing; Chen, Zhiyu; Liu, Sijia; Yang, Kaiyuan; Ren, Bin; Wang, Yanzhi; Lin, Xue

67ms on Mobile with over 78% ImageNet Accuracy - Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration Technical Report

2020.

Links | BibTeX

957.

Zhang, Haoyu; Jin, Yaochu; Cheng, Ran; Hao, Kuangrong

Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search Technical Report

2020.

Links | BibTeX

956.

Zhao, Z; -e Zhang, G; Jiang, M; Feng, L; Tan, K C

EDNAS: An Efficient Neural Architecture Design based on Distribution Estimation Technical Report

2020.

Links | BibTeX

955.

Awad, Noor; Mallik, Neeratyoy; Hutter, Frank

Differential Evolution for Neural Architecture Search Technical Report

2020.

Links | BibTeX

954.

Mazyavkina, Nina; Moustafa, S; Trofimov, Ilya; Burnaev, Evgeniy

Optimizing the Neural Architecture of Reinforcement Learning Agents Technical Report

2020.

Links | BibTeX

953.

Fan, Y; Tang, X; Zhou, G; Shen, J

EfficientAutoGAN: Predicting the rewards in reinforcement-based neural architecture search for Generative Adversarial Networks Technical Report

2020.

Links | BibTeX

952.

Ma, Benteng; Zhang, Jing; Xia, Yong; Tao, Dacheng

Inter-layer Transition in Neural Architecture Search Technical Report

2020.

Links | BibTeX

951.

Hu, Shengran; Cheng, Ran; He, Cheng; Lu, Zhichao

Multi-objective Neural Architecture Search with Almost No Training Technical Report

2020.

Links | BibTeX

950.

Kyriakides, George; Margaritis, Konstantinos G

NORD - A python framework for Neural Architecture Search Technical Report

2020.

Links | BibTeX

949.

Liang, Yi-Chuan; Liao, Ying-Chiao; Lin, Chen-Ching; Hung, Shih-Hao

Toward Fast Platform-Aware Neural Architecture Search for FPGA-Accelerated Edge AI Applications Proceedings Article

In: pp. 219-225, 2020.

Links | BibTeX

948.

Chen, Hanlin; Zhang, Baochang; Xue, Song; Gong, Xuan; Liu, Hong; Ji, Rongrong; Doermann, David S

Anti-bandit Neural Architecture Search for Model Defense Proceedings Article

In: pp. 70-85, 2020.

Links | BibTeX

947.

Borgohain, Satya; Kowadlo, Gideon; Rawlinson, David; Bergmeir, Christoph; Loo, Kok; Rangarajan, Harivallabha; Kuhlmann, Levin

Self-organising Neural Network Hierarchy Proceedings Article

In: pp. 359-370, 2020.

Links | BibTeX

946.

Mauch, Lukas; Tiedemann, Stephen; García, Javier Alonso; Cong, Bac Nguyen; Yoshiyama, Kazuki; Cardinaux, Fabien; Kemp, Thomas

Efficient Sampling for Predictor-Based Neural Architecture Search Technical Report

2020.

Links | BibTeX

945.

Wang, Xiaoxing; Chu, Xiangxiang; Fan, Yuda; Zhang, Zhexi; Wei, Xiaolin; Yan, Junchi; Yang, Xiaokang

ROME - Robustifying Memory-Efficient NAS via Topology Disentanglement and Gradients Accumulation Technical Report

2020.

Links | BibTeX

944.

Li, Xudong; Hu, Yang; Zheng, Jianhua; Li, Mingtao

Neural Architecture Search For Fault Diagnosis Technical Report

2020.

Links | BibTeX

943.

Yan, Zhicheng; Dai, Xiaoliang; Zhang, Peizhao; Tian, Yuandong; Wu, Bichen; Feiszli, Matt

FP-NAS - Fast Probabilistic Neural Architecture Search Technical Report

2020.

Links | BibTeX

942.

Ci, Yuanzheng; Lin, Chen; Sun, Ming; Chen, Boyu; Zhang, Hongwen; Ouyang, Wanli

Evolving Search Space for Neural Architecture Search Technical Report

2020.

Links | BibTeX

941.

ElSaid, AbdElRahman A; Karns, Joshua; Lyu, Zimeng; Ororbia, Alexander; Desell, Travis

Continuous Ant-Based Neural Topology Search Technical Report

2020.

Links | BibTeX

940.

Zhao, Tianchen; Ning, Xuefei; Yang, Songyi; Liang, Shuang; Lei, Peng; Chen, Jianfei; Yang, Huazhong; Wang, Yu

BARS - Joint Search of Cell Topology and Layout for Accurate and Efficient Binary ARchitectures Technical Report

2020.

Links | BibTeX

939.

Finkler, Ulrich; Merler, Michele; Panda, Rameswar; Jaiswal, Mayoore S; Wu, Hui; Ramakrishnan, Kandan; Chen, Chun-Fu; Cho, Minsik; Kung, David S; Feris, Rogério; Bhattacharjee, Bishwaranjan

Large Scale Neural Architecture Search with Polyharmonic Splines Technical Report

2020.

Links | BibTeX

4488 entries « 71 of 90 »