AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3157 entries « 45 of 64 »

2020

957.

Moons, Bert; Noorzad, Parham; Skliar, Andrii; Mariani, Giovanni; Mehta, Dushyant; Lott, Chris; Blankevoort, Tijmen

Distilling Optimal Neural Networks - Rapid Search in Diverse Spaces Technical Report

2020.

Links | BibTeX

956.

Zhang, Wenqiang; Fang, Jiemin; Wang, Xinggang; Liu, Wenyu

EfficientPose - Efficient Human Pose Estimation with Neural Architecture Search Technical Report

2020.

Links | BibTeX

955.

Awad, Noor H; Mallik, Neeratyoy; Hutter, Frank

Differential Evolution for Neural Architecture Search Technical Report

2020.

Links | BibTeX

954.

Sato, Rei; Sakuma, Jun; Akimoto, Youhei

AdvantageNAS - Efficient Neural Architecture Search with Credit Assignment Technical Report

2020.

Links | BibTeX

953.

Gallo, Ignazio; Magistrali, Gabriele; Landro, Nicola; Grassa, Riccardo La

Improving the Efficient Neural Architecture Search via Rewarding Modifications Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

952.

Kumar, Vidhur; Szidon, Andrew

Efficient Incorporation of Multiple Latency Targets in the Once-For-All Network Technical Report

2020.

Links | BibTeX

951.

Steuler, Jan Linus; Beck, Markus; Passow, Benjamin N; Guckert, Michael

Optimizing the Energy Consumption of Neural Networks Proceedings Article

In: pp. 2312-2319, 2020.

Links | BibTeX

950.

Kobayashi, Masayuki; Arai, Satoshi; Nagao, Tomoharu

Evolutionary Generative Contribution Mappings Proceedings Article

In: pp. 1657-1664, 2020.

Links | BibTeX

949.

Liu, Risheng; Ma, Long; Zhang, Jiaao; Fan, Xin; Luo, Zhongxuan

Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancement Technical Report

2020.

Links | BibTeX

948.

Li, Zhaoqun; Wang, Hongren; Li, Jinxing

Auto-MVCNN - Neural Architecture Search for Multi-view 3D Shape Recognition Technical Report

2020.

Links | BibTeX

947.

Xie, Pengtao; Du, Xuefeng; Ban, Hao

Skillearn: Machine Learning Inspired by Humans' Learning Skills Technical Report

2020.

Links | BibTeX

946.

Pan, Jingyu; Chang, Chen-Chia; Zhang, Tunhou; Xie, Zhiyao; Hu, Jiang; Qi, Weiyi; Lin, Chung-Wei; Liang, Rongjian; Mitra, Joydeep; Fallon, Elias; Chen, Yiran

Automatic Routability Predictor Development Using Neural Architecture Search Technical Report

2020.

Links | BibTeX

945.

Garcia-Valencia, Sebastian; Betancourt, Alejandro; Pulido, Juan Guillermo Lalinde

Sequence Generation using Deep Recurrent Networks and Embeddings - A study case in music Technical Report

2020.

Links | BibTeX

944.

Wang, Qifei; Ke, Junjie; Greaves, Joshua; Chu, Grace; Bender, Gabriel; Sbaiz, Luciano; Go, Alec; Howard, Andrew; Yang, Feng; Yang, Ming-Hsuan; Gilbert, Jeff; Milanfar, Peyman

Multi-path Neural Networks for On-device Multi-domain Visual Classification Technical Report

2020.

Links | BibTeX

943.

d'Avila Garcez, Artur; Lamb, Luis C

Neurosymbolic AI: The 3rd Wave Technical Report

2020.

Links | BibTeX

942.

Cheng, Hsin-Pai; Liang, Feng; Li, Meng; Cheng, Bowen; Yan, Feng; Li, Hai; Chandra, Vikas; Chen, Yiran

ScaleNAS - One-Shot Learning of Scale-Aware Representations for Visual Recognition Technical Report

2020.

Links | BibTeX

941.

Li, Zhengang; Yuan, Geng; Niu, Wei; Li, Yanyu; Zhao, Pu; Cai, Yuxuan; Shen, Xuan; Zhan, Zheng; Kong, Zhenglun; Jin, Qing; Chen, Zhiyu; Liu, Sijia; Yang, Kaiyuan; Ren, Bin; Wang, Yanzhi; Lin, Xue

67ms on Mobile with over 78% ImageNet Accuracy - Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration Technical Report

2020.

Links | BibTeX

940.

Zhang, Haoyu; Jin, Yaochu; Cheng, Ran; Hao, Kuangrong

Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search Technical Report

2020.

Links | BibTeX

939.

Zhao, Z; -e Zhang, G; Jiang, M; Feng, L; Tan, K C

EDNAS: An Efficient Neural Architecture Design based on Distribution Estimation Technical Report

2020.

Links | BibTeX

938.

Awad, Noor; Mallik, Neeratyoy; Hutter, Frank

Differential Evolution for Neural Architecture Search Technical Report

2020.

Links | BibTeX

937.

Mazyavkina, Nina; Moustafa, S; Trofimov, Ilya; Burnaev, Evgeniy

Optimizing the Neural Architecture of Reinforcement Learning Agents Technical Report

2020.

Links | BibTeX

936.

Fan, Y; Tang, X; Zhou, G; Shen, J

EfficientAutoGAN: Predicting the rewards in reinforcement-based neural architecture search for Generative Adversarial Networks Technical Report

2020.

Links | BibTeX

935.

Ma, Benteng; Zhang, Jing; Xia, Yong; Tao, Dacheng

Inter-layer Transition in Neural Architecture Search Technical Report

2020.

Links | BibTeX

934.

Hu, Shengran; Cheng, Ran; He, Cheng; Lu, Zhichao

Multi-objective Neural Architecture Search with Almost No Training Technical Report

2020.

Links | BibTeX

933.

Kyriakides, George; Margaritis, Konstantinos G

NORD - A python framework for Neural Architecture Search Technical Report

2020.

Links | BibTeX

932.

Liang, Yi-Chuan; Liao, Ying-Chiao; Lin, Chen-Ching; Hung, Shih-Hao

Toward Fast Platform-Aware Neural Architecture Search for FPGA-Accelerated Edge AI Applications Proceedings Article

In: pp. 219-225, 2020.

Links | BibTeX

931.

Chen, Hanlin; Zhang, Baochang; Xue, Song; Gong, Xuan; Liu, Hong; Ji, Rongrong; Doermann, David S

Anti-bandit Neural Architecture Search for Model Defense Proceedings Article

In: pp. 70-85, 2020.

Links | BibTeX

930.

Borgohain, Satya; Kowadlo, Gideon; Rawlinson, David; Bergmeir, Christoph; Loo, Kok; Rangarajan, Harivallabha; Kuhlmann, Levin

Self-organising Neural Network Hierarchy Proceedings Article

In: pp. 359-370, 2020.

Links | BibTeX

929.

Mauch, Lukas; Tiedemann, Stephen; García, Javier Alonso; Cong, Bac Nguyen; Yoshiyama, Kazuki; Cardinaux, Fabien; Kemp, Thomas

Efficient Sampling for Predictor-Based Neural Architecture Search Technical Report

2020.

Links | BibTeX

928.

Wang, Xiaoxing; Chu, Xiangxiang; Fan, Yuda; Zhang, Zhexi; Wei, Xiaolin; Yan, Junchi; Yang, Xiaokang

ROME - Robustifying Memory-Efficient NAS via Topology Disentanglement and Gradients Accumulation Technical Report

2020.

Links | BibTeX

927.

Li, Xudong; Hu, Yang; Zheng, Jianhua; Li, Mingtao

Neural Architecture Search For Fault Diagnosis Technical Report

2020.

Links | BibTeX

926.

Yan, Zhicheng; Dai, Xiaoliang; Zhang, Peizhao; Tian, Yuandong; Wu, Bichen; Feiszli, Matt

FP-NAS - Fast Probabilistic Neural Architecture Search Technical Report

2020.

Links | BibTeX

925.

Ci, Yuanzheng; Lin, Chen; Sun, Ming; Chen, Boyu; Zhang, Hongwen; Ouyang, Wanli

Evolving Search Space for Neural Architecture Search Technical Report

2020.

Links | BibTeX

924.

ElSaid, AbdElRahman A; Karns, Joshua; Lyu, Zimeng; Ororbia, Alexander; Desell, Travis

Continuous Ant-Based Neural Topology Search Technical Report

2020.

Links | BibTeX

923.

Zhao, Tianchen; Ning, Xuefei; Yang, Songyi; Liang, Shuang; Lei, Peng; Chen, Jianfei; Yang, Huazhong; Wang, Yu

BARS - Joint Search of Cell Topology and Layout for Accurate and Efficient Binary ARchitectures Technical Report

2020.

Links | BibTeX

922.

Finkler, Ulrich; Merler, Michele; Panda, Rameswar; Jaiswal, Mayoore S; Wu, Hui; Ramakrishnan, Kandan; Chen, Chun-Fu; Cho, Minsik; Kung, David S; Feris, Rogério; Bhattacharjee, Bishwaranjan

Large Scale Neural Architecture Search with Polyharmonic Splines Technical Report

2020.

Links | BibTeX

921.

Li, Yaoman; King, Irwin

AutoGraph - Automated Graph Neural Network Proceedings Article

In: pp. 189-201, 2020.

Links | BibTeX

920.

Yue, Zhixiong; Lin, Baijiong; Huang, Xiaonan; Zhang, Yu

Effective, Efficient and Robust Neural Architecture Search Technical Report

2020.

Links | BibTeX

919.

Nascimento, Marcelo Gennari Do; Costain, Theo W; Prisacariu, Victor Adrian

Finding Non-uniform Quantization Schemes Using Multi-task Gaussian Processes Proceedings Article

In: pp. 383-398, 2020.

Links | BibTeX

918.

Chu, Xiangxiang; Zhou, Tianbao; Zhang, Bo; Li, Jixiang

Fair DARTS - Eliminating Unfair Advantages in Differentiable Architecture Search Proceedings Article

In: pp. 465-480, 2020.

Links | BibTeX

917.

Dai, Xiyang; Chen, Dongdong; Liu, Mengchen; Chen, Yinpeng; Yuan, Lu

DA-NAS - Data Adapted Pruning for Efficient Neural Architecture Search Proceedings Article

In: pp. 584-600, 2020.

Links | BibTeX

916.

Hu, Yutao; Jiang, Xiaolong; Liu, Xuhui; Zhang, Baochang; Han, Jungong; Cao, Xianbin; Doermann, David S

NAS-Count - Counting-by-Density with Neural Architecture Search Proceedings Article

In: pp. 747-766, 2020.

Links | BibTeX

915.

Tabarisaadi, Pegah; Khosravi, Abbas; Nahavandi, Saeid

Bayesian Randomly Wired Neural Network with Variational Inference for Image Recognition Proceedings Article

In: pp. 197-207, 2020.

Links | BibTeX

914.

Vidnerová, Petra; Neruda, Roman

Multi-objective Evolution for Deep Neural Network Architecture Search Proceedings Article

In: pp. 270-281, 2020.

Links | BibTeX

913.

Hu, Kai; Ding, Dong; Tian, Shuo; Gong, Rui; Luo, Li; Wang, Lei

FTR-NAS - Fault-Tolerant Recurrent Neural Architecture Search Proceedings Article

In: pp. 589-597, 2020.

Links | BibTeX

912.

Pauletto, Loïc; Amini, Massih-Reza; Babbar, Rohit; Winckler, Nicolas

Neural Architecture Search for Extreme Multi-label Text Classification Proceedings Article

In: pp. 282-293, 2020.

Links | BibTeX

911.

Huang, Tao; You, Shan; Yang, Yibo; Tu, Zhuozhuo; Wang, Fei; Qian, Chen; Zhang, Changshui

Explicitly Learning Topology for Differentiable Neural Architecture Search Technical Report

2020.

Links | BibTeX

910.

Wang, Dilin; Li, Meng; Gong, Chengyue; Chandra, Vikas

AttentiveNAS - Improving Neural Architecture Search via Attentive Sampling Technical Report

2020.

Links | BibTeX

909.

McNally, William J; Vats, Kanav; Wong, Alexander; McPhee, John

EvoPose2D - Pushing the Boundaries of 2D Human Pose Estimation using Neuroevolution Technical Report

2020.

Links | BibTeX

908.

(Ed.)

Reducing Inference Latency with Concurrent Architectures for Image Recognition Collection

2020.

Links | BibTeX

3157 entries « 45 of 64 »