AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3157 entries « 31 of 64 »

2021

1657.

Burrello, Alessio; Pagliari, Daniele Jahier; Risso, Matteo; Benatti, Simone; Macii, Enrico; Benini, Luca; Poncino, Massimo

Q-PPG: Energy-Efficient PPG-based Heart Rate Monitoring on Wearable Devices Journal Article

In: IEEE Trans Biomed Circuits Syst ., 2021.

Links | BibTeX

1656.

Wang, Ning; Gao, Yang; Chen, Hao; Wang, Peng; Tian, Zhi; Shen, Chunhua; Zhang, Yanning

NAS-FCOS: Efficient Search for Object Detection Architectures Journal Article

In: International Journal of Computer Vision , vol. 129, pp. 3299–3312, 2021.

Links | BibTeX

1655.

Oyelade, Olaide N.; Ezugwu, Absalom E.

A bioinspired neural architecture search based convolutional neural network for breast cancer detection using histopathology images Journal Article

In: Scientific Reports, 2021.

Links | BibTeX

1654.

Wang, Yaoming; Liu, Yuchen; Dai, Wenrui; Li, Chenglin; Zou, Junni; Xiong, Hongkai

Learning Latent Architectural Distribution in Differentiable Neural Architecture Search via Variational Information Maximization Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 12312-12321, 2021.

Links | BibTeX

1653.

Chen, Ziye; Zhan, Yibing; Yu, Baosheng; Gong, Mingming; Du, Bo

Not All Operations Contribute Equally: Hierarchical Operation-Adaptive Predictor for Neural Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 10508-10517, 2021.

Links | BibTeX

1652.

Zeng, Dan; Huang, Yuhang; Bao, Qian; Zhang, Junjie; Su, Chi; Liu, Wu

Neural Architecture Search for Joint Human Parsing and Pose Estimation Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 11385-11394, 2021.

Links | BibTeX

1651.

Chatzianastasis, Michail; Dasoulas, George; Siolas, Georgios; Vazirgiannis, Michalis

Graph-Based Neural Architecture Search With Operation Embeddings Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, pp. 393-402, 2021.

Links | BibTeX

1650.

Hu, Xiaobin; Ren, Wenqi; Yu, Kaicheng; Zhang, Kaihao; Cao, Xiaochun; Liu, Wei; Menze, Bjoern

Pyramid Architecture Search for Real-Time Image Deblurring Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 4298-4307, 2021.

Links | BibTeX

1649.

Chu, Xiangxiang; Zhang, Bo; Li, Qingyuan; Xu, Ruijun; Li, Xudong

SCARLET-NAS: Bridging the Gap Between Stability and Scalability in Weight-Sharing Neural Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, pp. 317-325, 2021.

Links | BibTeX

1648.

Xue, Song; Wang, Runqi; Zhang, Baochang; Wang, Tian; Guo, Guodong; Doermann, David

IDARTS: Interactive Differentiable Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 1163-1172, 2021.

Links | BibTeX

1647.

Shen, Mingzhu; Liang, Feng; Gong, Ruihao; Li, Yuhang; Li, Chuming; Lin, Chen; Yu, Fengwei; Yan, Junjie; Ouyang, Wanli

Once Quantization-Aware Training: High Performance Extremely Low-Bit Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 5340-5349, 2021.

Links | BibTeX

1646.

Lin, Ming; Wang, Pichao; Sun, Zhenhong; Chen, Hesen; Sun, Xiuyu; Qian, Qi; Li, Hao; Jin, Rong

Zen-NAS: A Zero-Shot NAS for High-Performance Image Recognition Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 347-356, 2021.

Links | BibTeX

1645.

Zhou, Qinqin; Zheng, Xiawu; Cao, Liujuan; Zhong, Bineng; Xi, Teng; Zhang, Gang; Ding, Errui; Xu, Mingliang; Ji, Rongrong

EC-DARTS: Inducing Equalized and Consistent Optimization Into DARTS Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 11986-11995, 2021.

Links | BibTeX

1644.

Rana, Amrita; Kim, Kyung Ki

Robust architecture search using network adaptation Journal Article

In: Journal of Sensor Science and Technology, vol. 30, no. 5, pp. 290-294, 2021.

Links | BibTeX

1643.

Yan, Kefan; Wang, Shunlong; Guan, Yuwei; Jiang, Ailian

TNAS: Neural Network Architecture Search Sampling Module Based on Variational Autoencoder Journal Article

In: CONVERTER, pp. 288-296, 2021.

Links | BibTeX

1642.

Hao, Jie; Cai, Zhiling; Li, Ruijia; Zhu, William

Saliency: a new selection criterion of important architectures in neural architecture search Journal Article

In: Neural Computing and Applications, 2021.

Links | BibTeX

1641.

Jia, Hong; Hu, Jiawei; Hu, Wen

SwingNet: Ubiquitous Fine-Grained Swing Tracking Framework via Stochastic Neural Architecture Search and Adversarial Learning Journal Article

In: Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., vol. 5, no. 3, 2021.

Abstract | Links | BibTeX

1640.

Cazasnoves, Anthony; Ganaye, Pierre-Antoine; Sanchis, Kévin; Ceillier, Tugdual

Neural Architecture Search in operational context: a remote sensing case-study Technical Report

Preligens 2021.

Links | BibTeX

1639.

Yang, Xin; Fan, Jiangfeng; Wu, Chenhuan; Zhou, Dake; Li, Tao

NasmamSR: a fast image super-resolution network based on neural architecture search and multiple attention mechanism Journal Article

In: Multimedia Systems (2021), 2021.

Links | BibTeX

1638.

Wendlinger, Lorenz; Berndl, Emanuel; Granitzer, Michael

Methods for Automatic Machine-Learning Workflow Analysis Proceedings Article

In: ECML PKDD 2021, 2021.

Links | BibTeX

1637.

Zhao, Zimin; Kang, Ying; Hou, Aiqin; Gan, Daguang

SP-DARTS: Synchronous Progressive Differentiable Neural Architecture Search for Image Classification Journal Article

In: IEICE TRANSACTIONS on Information and Systems , vol. E104-D , no. 8 , pp. 1232-1238, 2021, ISBN: 1745-1361.

Links | BibTeX

1636.

Ding, Yuhui; Yao, Quanming; Zhao, Huan; Zhang, Tong

DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks Proceedings Article

In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery &amp$mathsemicolon$ Data Mining, ACM, 2021.

Links | BibTeX

1635.

Zhu, Yanming; Meijering, Erik

Automatic Improvement of Deep Learning Based Cell Segmentation in Time-Lapse Microscopy by Neural Architecture Search Journal Article

In: Bioinformatics, 2021.

Links | BibTeX

1634.

Zhao, Jiejie; Lv, Weifeng; Du, Bowen; Ye, Junchen; Sun, Leilei; Xiong, Guixi

Deep multi-task learning with flexible and compact architecture search Journal Article

In: International Journal of Data Science and Analytics , 2021.

Links | BibTeX

1633.

Nguyen, Vu; Le, Tam; Yamada, Makoto; Osborne, Michael A

Optimal Transport Kernels for Sequential and Parallel Neural Architecture Search Proceedings Article

In: Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, 2021.

Links | BibTeX

1632.

Ünal, Hamit Taner; Başçiftçi, Fatih

Evolutionary design of neural network architectures: a review of three decades of research Journal Article

In: Artificial Intelligence Review, 2021.

Links | BibTeX

1631.

Dimanov, Daniel; Balaguer-Ballester, Emili; Singleton, Colin; Rostami, Shahin

Moncae: Multi-Objective Neuroevolution of Convolutional Autoencoders Proceedings Article

In: 2nd Workshop on Neural Architecture Search at ICLR 2021, 2021.

Links | BibTeX

1630.

Lin, Yi; Liu, Yanfei; Liu, Jingguang; Liu, Guocai; Ma, Kai; Zheng, Yefeng

LE-NAS: Learning-based Ensemble with Neural Architecture Search for 3D Radiotherapy Dose Prediction Journal Article

In: 2021.

Links | BibTeX

1629.

White, Colin; Nolen, Sam; Savani, Yash

Exploring the Loss Landscape in Neural Architecture Search Proceedings Article

In: 37th Conference on Uncertainty in Artificial Intelligence (UAI 2021), 2021.

Links | BibTeX

1628.

Sääw, Daniel; Nijweide, Frederik

Exploring the feasibility of Weight Agnostic Neural Networks for low-end hardware Technical Report

2021.

Links | BibTeX

1627.

Tian, Ye; Peng, Shichen; Yang, Shangshang; Zhang, Xingyi; Tan, Kay Chen; Jin, Yaochu

Action Command Encoding for SurrogateAssisted Neural Architecture Search Technical Report

2021.

Links | BibTeX

1626.

Siems, Julien; Klein, Aaron; Archambeau, Cedric; Mahsereci, Maren

Dynamic Pruning of a Neural Networkvia Gradient Signal-to-Noise Ratio Proceedings Article

In: 8th ICML Workshop on Automated Machine Learning (2021), 2021.

Links | BibTeX

1625.

Yu, Kaicheng

From Human-Designed Convolutional Neural Networks Towards Robust Neural Architecture Search PhD Thesis

2021.

Abstract | Links | BibTeX

1624.

Coquelin, Daniel; Sedona, Rocco; Riedel, Morris; Götz, Markus

Evolutionary Optimization of Neural Architectures in Remote Sensing Classification Problems Technical Report

2021.

Links | BibTeX

1623.

Jin, Yaochu; Wang, Handing; Sun, Chaoli

Surrogate-Assisted Evolutionary Neural Architecture Search Proceedings Article

In: Data-Driven Evolutionary Optimization, pp. 373-387, 2021, ISBN: 978-3-030-74640-7.

Links | BibTeX

1622.

Zhu, Wei; Ni, Yuan; Wang, Xiaoling; Xie, Guotong; Zhang, Fang

Discovering Better Model Architectures for Medical Query Understanding Proceedings Article

In: Proceedings of NAACL HLT 2021: IndustryTrack Papers, pp. 230-237, 2021.

Links | BibTeX

1621.

Tsokov, Stefan; Lazarova, Milena; Aleksieva-Petrova, Adelina

An Evolutionary Approach to the Design of Convolutional Neural Networks for Human Activity Recognition Journal Article

In: Indian Journal of Computer Science and Engineering, 2021.

Links | BibTeX

1620.

Geraeinejad, V.; Seenan, S.; Modarressi, M.; Daneshtalab, M.

RoCo-NAS : Robust and Compact Neural Architecture Search Proceedings Article

In: The international joint conference on neural networks IJCNN, 2021.

Links | BibTeX

1619.

Liu, Shaoli; Zheng, Chengjian; Lu, Kaidi; Gao, Si; Wang, Ning; Wang, Bofei; Zhang, Diankai; Zhang, Xiaofeng; Xu, Tianyu

EVSRNet: Efficient Video Super-Resolution With Neural Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pp. 2480-2485, 2021.

Links | BibTeX

1618.

Ma, Xiaohan; Si, Chang; Wang, Ying; Liu, Cheng; Zhang1, Lei

NASA: Accelerating Neural Network Design with a NAS Processor Proceedings Article

In: 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA), 2021.

Links | BibTeX

1617.

Dai, Xiaoliang; Wan, Alvin; Zhang, Peizhao; Wu, Bichen; He, Zijian; Wei, Zhen; Chen, Kan; Tian, Yuandong; Yu, Matthew; Vajda, Peter; Gonzalez, Joseph E.

FBNetV3: Joint Architecture-Recipe Search using Predictor Pretraining Book Section

In: CVPR2021, 2021.

Links | BibTeX

1616.

Huang, Shenyang; Francois-Lavet, Vincent; Rabusseau, Guillaume

Understanding Capacity Saturation in Incremental Learning Proceedings Article

In: The 34th Canadian Conference on Artificial Intelligence, 2021.

Links | BibTeX

1615.

Chen, Wuyang; Gong, Xinyu; Wang, Zhangyang

Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective Proceedings Article

In: ICLR 2021, 2021.

Links | BibTeX

1614.

Yang, Yuxuan; Gao, Zhongke; Li, Yanli; Wang, He

A CNN identified by reinforcement learning-based optimization framework for EEG-based state evaluation Journal Article

In: Journal of Neural Engineering, vol. 18, no. 4, pp. 046059, 2021.

Abstract | Links | BibTeX

1613.

Schoenherr, Georg P.

The Nonlinearity Coefficient - A Practical Guide to Neural Architecture Design PhD Thesis

2021.

Links | BibTeX

1612.

Zhang, Yi; Liu, Yang; Liu, X. Shirley

Neural network architecture search with AMBER Journal Article

In: Nature Machine Intelligence, pp. 372-373, 2021.

Links | BibTeX

1611.

Yuan, Zhihang; Liu, Jingze; Li, Xingchen; Yan, Longhao; Chen, Haoxiang; Wu, Bingzhe; Yang, Yuchao; Sun, Guangyu

NAS4RRAM: neural network architecture search for inference on RRAM-based accelerators Journal Article

In: Science China Information Sciences, 2021.

Links | BibTeX

1610.

Perenda, Erma; Rajendran, Sreeraj; Bovet, Gerome; Pollin, Sofie; Zheleva, Mariya

Evolutionary Optimization of Residual Neural Network Architectures for Modulation Classification Miscellaneous

2021.

Links | BibTeX

1609.

Wang, Xiaobo

Teacher Guided Neural Architecture Search for Face Recognition Journal Article

In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 4, pp. 2817-2825, 2021.

Links | BibTeX

1608.

Anwar, Abrar

Evolving Spiking Circuit Motifs Using Weight Agnostic Neural Networks Journal Article

In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 18, pp. 15956-15957, 2021.

Links | BibTeX

3157 entries « 31 of 64 »