AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3369 entries « 50 of 68 »

2020

919.

Dai, Xiyang; Chen, Dongdong; Liu, Mengchen; Chen, Yinpeng; Yuan, Lu

DA-NAS - Data Adapted Pruning for Efficient Neural Architecture Search Proceedings Article

In: pp. 584-600, 2020.

Links | BibTeX

918.

Hu, Yutao; Jiang, Xiaolong; Liu, Xuhui; Zhang, Baochang; Han, Jungong; Cao, Xianbin; Doermann, David S

NAS-Count - Counting-by-Density with Neural Architecture Search Proceedings Article

In: pp. 747-766, 2020.

Links | BibTeX

917.

Tabarisaadi, Pegah; Khosravi, Abbas; Nahavandi, Saeid

Bayesian Randomly Wired Neural Network with Variational Inference for Image Recognition Proceedings Article

In: pp. 197-207, 2020.

Links | BibTeX

916.

Vidnerová, Petra; Neruda, Roman

Multi-objective Evolution for Deep Neural Network Architecture Search Proceedings Article

In: pp. 270-281, 2020.

Links | BibTeX

915.

Hu, Kai; Ding, Dong; Tian, Shuo; Gong, Rui; Luo, Li; Wang, Lei

FTR-NAS - Fault-Tolerant Recurrent Neural Architecture Search Proceedings Article

In: pp. 589-597, 2020.

Links | BibTeX

914.

Pauletto, Loïc; Amini, Massih-Reza; Babbar, Rohit; Winckler, Nicolas

Neural Architecture Search for Extreme Multi-label Text Classification Proceedings Article

In: pp. 282-293, 2020.

Links | BibTeX

913.

Huang, Tao; You, Shan; Yang, Yibo; Tu, Zhuozhuo; Wang, Fei; Qian, Chen; Zhang, Changshui

Explicitly Learning Topology for Differentiable Neural Architecture Search Technical Report

2020.

Links | BibTeX

912.

Wang, Dilin; Li, Meng; Gong, Chengyue; Chandra, Vikas

AttentiveNAS - Improving Neural Architecture Search via Attentive Sampling Technical Report

2020.

Links | BibTeX

911.

McNally, William J; Vats, Kanav; Wong, Alexander; McPhee, John

EvoPose2D - Pushing the Boundaries of 2D Human Pose Estimation using Neuroevolution Technical Report

2020.

Links | BibTeX

910.

(Ed.)

Reducing Inference Latency with Concurrent Architectures for Image Recognition Collection

2020.

Links | BibTeX

909.

Heidari, Negar; Iosifidis, Alexandros

Progressive Spatio-Temporal Graph Convolutional Network for Skeleton-Based Human Action Recognition Technical Report

2020.

Links | BibTeX

908.

Lee, Royson; Dudziak, Lukasz; Abdelfattah, Mohamed S; Venieris, Stylianos I; Kim, Hyeji; Wen, Hongkai; Lane, Nicholas D

Journey Towards Tiny Perceptual Super-Resolution Proceedings Article

In: pp. 85-102, 2020.

Links | BibTeX

907.

Pasunuru, Ramakanth; Bansal, Mohit

FENAS - Flexible and Expressive Neural Architecture Search Proceedings Article

In: pp. 2869-2876, 2020.

Links | BibTeX

906.

Park, Daniel S; Lee, Jaehoon; Peng, Daiyi; Cao, Yuan; Sohl-Dickstein, Jascha

Towards NNGP-guided Neural Architecture Search Technical Report

2020.

Links | BibTeX

905.

Zheng, Huahuan; An, Keyu; Ou, Zhijian

Efficient Neural Architecture Search for End-to-end Speech Recognition via Straight-Through Gradients Technical Report

2020.

Links | BibTeX

904.

Calisto, Maria Baldeon G; Lai-Yuen, Susana K

Neural Architecture Search with an Efficient Multiobjective Evolutionary Framework Technical Report

2020.

Links | BibTeX

903.

Liu, Chang; Tian, Yunjie; Jiao, Jianbin; Ye, Qixiang

Adaptive Linear Span Network for Object Skeleton Detection Technical Report

2020.

Links | BibTeX

902.

Zhang, Chunhui; Liang, Yongyuan; Yuan, Xiaoming; Cheng, Lei

FDNAS - Improving Data Privacy and Model Diversity in AutoML Technical Report

2020.

Links | BibTeX

901.

Li, Yanxi; Yang, Zhaohui; Wang, Yunhe; Xu, Chang

Adapting Neural Architectures Between Domains Proceedings Article

In: 2020.

Links | BibTeX

900.

Shi, Han; Pi, Renjie; Xu, Hang; Li, Zhenguo; Kwok, James T; Zhang, Tong

Bridging the Gap between Sample-based and One-shot Neural Architecture Search with BONAS Proceedings Article

In: 2020.

Links | BibTeX

899.

Zhou, Pan; Xiong, Caiming; Socher, Richard; Hoi, Steven Chu-Hong

Theory-Inspired Path-Regularized Differential Network Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

898.

Luo, Renqian; Tan, Xu; Wang, Rui; Qin, Tao; Chen, Enhong; Liu, Tie-Yan

Semi-Supervised Neural Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

897.

Ryu, Jeongun; Shin, Jaewoong; Lee, Haebeom; Hwang, Sung Ju

MetaPerturb - Transferable Regularizer for Heterogeneous Tasks and Architectures Proceedings Article

In: 2020.

Links | BibTeX

896.

Yan, Shen; Zheng, Yu; Ao, Wei; Zeng, Xiao; Zhang, Mi

Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Proceedings Article

In: 2020.

Links | BibTeX

895.

White, Colin; Neiswanger, Willie; Nolen, Sam; Savani, Yash

A Study on Encodings for Neural Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

894.

Wang, Xiaofang; Xiong, Xuehan; Neumann, Maxim; Piergiovanni, A J; Ryoo, Michael S; Angelova, Anelia; Kitani, Kris M; Hua, Wei

AttentionNAS - Spatiotemporal Attention Cell Search for Video Classification Proceedings Article

In: pp. 449-465, 2020.

Links | BibTeX

893.

Yu, Zitong; Wan, Jun; Qin, Yunxiao; Li, Xiaobai; Li, Stan Z; Zhao, Guoying

NAS-FAS - Static-Dynamic Central Difference Network Search for Face Anti-Spoofing Technical Report

2020.

Links | BibTeX

892.

You, Jiaxuan; Ying, Zhitao; Leskovec, Jure

Design Space for Graph Neural Networks Proceedings Article

In: 2020.

Links | BibTeX

891.

Mitsuno, Kakeru; Nomura, Yuichiro; Kurita, Takio

Channel Planting for Deep Neural Networks using Knowledge Distillation Technical Report

2020.

Links | BibTeX

890.

Guan, Yushuo; Liu, Ning; Zhao, Pengyu; Che, Zhengping; Bian, Kaigui; Wang, Yanzhi; Tang, Jian

DAIS - Automatic Channel Pruning via Differentiable Annealing Indicator Search Technical Report

2020.

Links | BibTeX

889.

Zhang, Yongqi; Yao, Quanming; Chen, Lei

Interstellar - Searching Recurrent Architecture for Knowledge Graph Embedding Proceedings Article

In: 2020.

Links | BibTeX

888.

Wang, Jiaxing; Bai, Haoli; Wu, Jiaxiang; Shi, Xupeng; Huang, Junzhou; King, Irwin; Lyu, Michael R; Cheng, Jian

Revisiting Parameter Sharing for Automatic Neural Channel Number Search Proceedings Article

In: 2020.

Links | BibTeX

887.

Wu, Lemeng; Liu, Bo; Stone, Peter; Liu, Qiang

Firefly Neural Architecture Descent - a General Approach for Growing Neural Networks Proceedings Article

In: 2020.

Links | BibTeX

886.

Gou, Yuanbiao; Li, Boyun; Liu, Zitao; Yang, Songfan; Peng, Xi

CLEARER - Multi-Scale Neural Architecture Search for Image Restoration Proceedings Article

In: 2020.

Links | BibTeX

885.

Wang, Bochao; Xu, Hang; Zhang, Jiajin; Chen, Chen; Xu, Yixing; Fang, Xiaozhi; Kang, Ning; Hong, Lanqing; Jiang, Chenhan; Cai, Xinyue; Li, Jiawei; Zhou, Fengwei; Li, Yong; Liu, Zhicheng; Chen, Xinghao; Han, Kai; Shu, Han; Song, Dehua; Wang, Yunhe; Zhang, Wei; Xu, Chunjing; Li, Zhenguo; Liu, Wenzhi; Zhang, Tong

VEGA - Towards an End-to-End Configurable AutoML Pipeline Technical Report

2020.

Links | BibTeX

884.

van Stein, Bas; Wang, Hao; Bäck, Thomas

Neural Network Design - Learning from Neural Architecture Search Proceedings Article

In: pp. 1341-1349, 2020.

Links | BibTeX

883.

Wei, Chen; Tang, Yiping; Niu, Chuang; Hu, Haihong; Wang, Yue; Liang, Jimin

Self-supervised Representation Learning for Evolutionary Neural Architecture Search Technical Report

2020.

Links | BibTeX

882.

Yang, Yao; Nam, Andrew; Nasr-Azadani, Mohamad M; Tung, Teresa

Resource-Aware Pareto-Optimal Automated Machine Learning Platform Technical Report

2020.

Links | BibTeX

881.

Lu, Zhichao; Deb, Kalyanmoy; Goodman, Erik D; Banzhaf, Wolfgang; Boddeti, Vishnu Naresh

NSGANetV2 - Evolutionary Multi-objective Surrogate-Assisted Neural Architecture Search Proceedings Article

In: pp. 35-51, 2020.

Links | BibTeX

880.

Wu, Yangxin; Zhang, Gengwei; Xu, Hang; Liang, Xiaodan; Lin, Liang

Auto-Panoptic - Cooperative Multi-Component Architecture Search for Panoptic Segmentation Proceedings Article

In: 2020.

Links | BibTeX

879.

Repin, Denis; Phung, Nhat-Huy; Petrov, Tatjana

StochNetV2 - A Tool for Automated Deep Abstractions for Stochastic Reaction Networks Proceedings Article

In: pp. 27-32, 2020.

Links | BibTeX

878.

Zhao, Wenyu; Ma, Teli; Gong, Xuan; Zhang, Baochang; Doermann, David S

A Review of Recent Advances of Binary Neural Networks for Edge Computing Technical Report

2020.

Links | BibTeX

877.

Deng, Zhijie; Dong, Yinpeng; Zhang, Shifeng; Zhu, Jun

Understanding and Exploring the Network with Stochastic Architectures Proceedings Article

In: 2020.

Links | BibTeX

876.

Peng, Houwen; Du, Hao; Yu, Hongyuan; Li, Qi; Liao, Jing; Fu, Jianlong

Cream of the Crop - Distilling Prioritized Paths For One-Shot Neural Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

875.

Wei, Jiahong; Fan, Zhun

Genetic U-Net - Automatically Designing Lightweight U-shaped CNN Architectures Using the Genetic Algorithm for Retinal Vessel Segmentation Technical Report

2020.

Links | BibTeX

874.

Han, Kai; Wang, Yunhe; Zhang, Qiulin; Zhang, Wei; Xu, Chunjing; Zhang, Tong

Model Rubik's Cube: Twisting Resolution, Depth and Width for TinyNets Technical Report

2020.

Links | BibTeX

873.

Zhang, Yongan; Fu, Yonggan; Jiang, Weiwen; Li, Chaojian; You, Haoran; Li, Meng; Chandra, Vikas; Lin, Yingyan

DNA - Differentiable Network-Accelerator Co-Search Technical Report

2020.

Links | BibTeX

872.

Celik, Bilge; Vanschoren, Joaquin

Adaptation Strategies for Automated Machine Learning on Evolving Data Technical Report

2020.

Links | BibTeX

871.

Zhang, Miao; Li, Huiqi; Pan, Shirui; Chang, Xiaojun; Ge, Zongyuan; Su, Steven W

Differentiable Neural Architecture Search in Equivalent Space with Exploration Enhancement Proceedings Article

In: 2020.

Links | BibTeX

870.

Li, Ting; Zhang, Junbo; Bao, Kainan; Liang, Yuxuan; Li, Yexin; Zheng, Yu

AutoST - Efficient Neural Architecture Search for Spatio-Temporal Prediction Proceedings Article

In: pp. 794-802, 2020.

Links | BibTeX

3369 entries « 50 of 68 »