AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.

3280 entries « ‹ 33 of 66 › »

2022

1680.

Noce, Julia; Chantong, Gianella; Jauregui, Gustavo; Mogami, Roberto; Monteiro, Alexandra; Figueiredo, Karla; Vellasco, Marley

Äpplied Enhanced Q-NAS for COVID-19 Detection in CT Images Proceedings Article

In: Mahmud, Mufti; Ieracitano, Cosimo; Kaiser, M. Shamim; Mammone, Nadia; Morabito, Francesco Carlo (Ed.): Äpplied Intelligence and Informatics", pp. 419–433, Springer Nature Switzerland, Cham, 2022, ISBN: 978-3-031-24801-6.

Abstract | BibTeX

1679.

Song, Li; Bao, Kainan; Ke, Songyu; Li, Chunyang; Zhang, Junbo; Zheng, Yu

Efficient Spatio-Temporal Randomly Wired Neural Networks for Traffic Forecasting Proceedings Article

In: 2022 IEEE International Conference on Data Mining Workshops (ICDMW), pp. 1-8, 2022.

1678.

Sun, Hanbo; Wang, Chenyu; Zhu, Zhenhua; Ning, Xuefei; Dai, Guohao; Yang, Huazhong; Wang, Yu

Gibbon: Efficient Co-Exploration of NN Model and Processing-In-Memory Architecture Proceedings Article

In: 2022 Design, Automation & Test in Europe Conference & Exhibition (DATE), pp. 867-872, 2022.

1677.

Krishnakumar, Arjun; White, Colin; Zela, Arber; Tu, Renbo; Safari, Mahmoud; Hutter, Frank

NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxies Proceedings Article

In: 2022.

1676.

Ghosh, Arjun; Jana, Nanda Dulal

Artificial Bee Colony Optimization based Optimal Convolutional Neural Network Architecture Design Proceedings Article

In: 2022 IEEE 19th India Council International Conference (INDICON), pp. 1-7, 2022.

2021

1675.

Jixiang Li Shun Lu, Jianchao Tan

TNASP: A Transformer-based NAS Predictor with a Self-evolution Framework Proceedings Article

In: 35th Conference on Neural Information Processing Systems (NeurIPS 2021), 2021.

1674.

Hao, Jie; Zhu, William

Layered Feature Representation for Differentiable Architecture Search Technical Report

2021.

1673.

Choe, Hyeokjun; Na, Byunggook; Mok, Jisoo; Yoon, Sungroh

Variance-stationary Differentiable NAS Proceedings Article

In: British Machine Vision Conference (BMVC) 2021, 2021.

1672.

Mo, Shentong; Xia, Jingfei; Ren, Pinxu

Simulated Annealing for Neural Architecture Search Proceedings Article

In: OPT2021: 13th Annual Workshop on Optimization for Machine Learning, 2021.

1671.

Wang, Zifu; Blaschko, Matthew B.

MRF-NAS: Improving UNet with Neural Architecture Search for Medical Image Segmentation Technical Report

2021.

1670.

Huang, Ziyan; Wang, Zehua; Yang, Zhikai; Gu, Lixu

AdwU-Net: Adaptive Depth and Width U-Net for Medical Image Segmentation by Differentiable Neural Architecture Search Technical Report

2021.

1669.

Tran, Linh Tam; Baea, Sung-Ho

Training-Free Hardware-Aware Neural Architecture Search with Reinforcement Learning Technical Report

2021.

1668.

Gao, Yang; Zhang, Peng; Li, Zhao; Zhou, Chuan; Liu, Yongchao; Hu, Yue

Heterogeneous Graph Neural Architecture Search Proceedings Article

In: 2021 IEEE International Conference on Data Mining (ICDM), 2021.

1667.

Prashanth, Thota Guna Durga; Reddy, Pendli Rishith

Anomaly based Intrusion Detection using Neural Networks in 5G Network Journal Article

In: International Journal for Research in Applied Science & Engineering Technology (IJRASET), vol. 9, iss. 12, 2021, ISSN: 2321-9653.

1666.

Ye, Andre

Successful Neural Network Architecture Design Book Chapter

In: Apress, Berkeley, CA, 2021.

1665.

Yan, C.; Chang, X.; Li, Z.; Guan, W.; Ge, Z.; Zhu, L.; Zheng, Q.

ZeroNAS: Differentiable Generative Adversarial Networks Search for Zero-Shot Learning Journal Article

In: IEEE Transactions on Pattern Analysis & Machine Intelligence, no. 01, pp. 1-1, 2021, ISSN: 1939-3539.

1664.

Wang, Shurun; Tang, Hao; Wang, Bin; Mo, Jia

A Novel Approach to Detecting Muscle Fatigue Based on sEMG by Using Neural Architecture Search Framework Proceedings Article

In: IEEE Trans Neural Netw Learn Syst, 2021.

1663.

Li, Siyi; Sun, Yanan; Yen, Gary G; Zhang, Mengjie

Automatic Design of Convolutional Neural Network Architectures Under Resource Constraints Proceedings Article

In: IEEE Trans Neural Netw Learn Syst ., 2021.

1662.

Nangi, Sharmila Reddy; Tyagi, Atharv; Mundra, Jay; Mukherjee, Sagnik; Snehal, Raj; Chhaya, Niyati; Garimella, Aparna

AUTOSUMM: Automatic Model Creation for Text Summarization Proceedings Article

In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 10162–10172, Ässociation for Computational Linguistics, Önline and Punta Cana, Dominican Republic, 2021.

Abstract | Links | BibTeX

1661.

Liu, Zhengying

Automated Deep Learning : Principles and Practice PhD Thesis

2021.

1660.

Nguyen, N.; Chang, M. J.

CSNAS: Contrastive Self-supervised Learning Neural Architecture Search via Sequential Model-Based Optimization Journal Article

In: IEEE Transactions on Artificial Intelligence, vol. 1, no. 01, pp. 1-1, 2021.

1659.

Chen, Zerui; Huang, Yan; Yu, Hongyuan; Wang, Liang

Learning a Robust Part-Aware Monocular 3D Human Pose Estimator via Neural Architecture Search Journal Article

In: International Journal of Computer Vision (2021), 2021.

1658.

Burrello, Alessio; Pagliari, Daniele Jahier; Risso, Matteo; Benatti, Simone; Macii, Enrico; Benini, Luca; Poncino, Massimo

Q-PPG: Energy-Efficient PPG-based Heart Rate Monitoring on Wearable Devices Journal Article

In: IEEE Trans Biomed Circuits Syst ., 2021.

1657.

Wang, Ning; Gao, Yang; Chen, Hao; Wang, Peng; Tian, Zhi; Shen, Chunhua; Zhang, Yanning

NAS-FCOS: Efficient Search for Object Detection Architectures Journal Article

In: International Journal of Computer Vision , vol. 129, pp. 3299–3312, 2021.

1656.

Oyelade, Olaide N.; Ezugwu, Absalom E.

A bioinspired neural architecture search based convolutional neural network for breast cancer detection using histopathology images Journal Article

In: Scientific Reports, 2021.

1655.

Wang, Yaoming; Liu, Yuchen; Dai, Wenrui; Li, Chenglin; Zou, Junni; Xiong, Hongkai

Learning Latent Architectural Distribution in Differentiable Neural Architecture Search via Variational Information Maximization Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 12312-12321, 2021.

1654.

Chen, Ziye; Zhan, Yibing; Yu, Baosheng; Gong, Mingming; Du, Bo

Not All Operations Contribute Equally: Hierarchical Operation-Adaptive Predictor for Neural Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 10508-10517, 2021.

1653.

Zeng, Dan; Huang, Yuhang; Bao, Qian; Zhang, Junjie; Su, Chi; Liu, Wu

Neural Architecture Search for Joint Human Parsing and Pose Estimation Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 11385-11394, 2021.

1652.

Chatzianastasis, Michail; Dasoulas, George; Siolas, Georgios; Vazirgiannis, Michalis

Graph-Based Neural Architecture Search With Operation Embeddings Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, pp. 393-402, 2021.

1651.

Hu, Xiaobin; Ren, Wenqi; Yu, Kaicheng; Zhang, Kaihao; Cao, Xiaochun; Liu, Wei; Menze, Bjoern

Pyramid Architecture Search for Real-Time Image Deblurring Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 4298-4307, 2021.

1650.

Chu, Xiangxiang; Zhang, Bo; Li, Qingyuan; Xu, Ruijun; Li, Xudong

SCARLET-NAS: Bridging the Gap Between Stability and Scalability in Weight-Sharing Neural Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, pp. 317-325, 2021.

1649.

Xue, Song; Wang, Runqi; Zhang, Baochang; Wang, Tian; Guo, Guodong; Doermann, David

IDARTS: Interactive Differentiable Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 1163-1172, 2021.

1648.

Shen, Mingzhu; Liang, Feng; Gong, Ruihao; Li, Yuhang; Li, Chuming; Lin, Chen; Yu, Fengwei; Yan, Junjie; Ouyang, Wanli

Once Quantization-Aware Training: High Performance Extremely Low-Bit Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 5340-5349, 2021.

1647.

Lin, Ming; Wang, Pichao; Sun, Zhenhong; Chen, Hesen; Sun, Xiuyu; Qian, Qi; Li, Hao; Jin, Rong

Zen-NAS: A Zero-Shot NAS for High-Performance Image Recognition Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 347-356, 2021.

1646.

Zhou, Qinqin; Zheng, Xiawu; Cao, Liujuan; Zhong, Bineng; Xi, Teng; Zhang, Gang; Ding, Errui; Xu, Mingliang; Ji, Rongrong

EC-DARTS: Inducing Equalized and Consistent Optimization Into DARTS Proceedings Article

In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 11986-11995, 2021.

1645.

Rana, Amrita; Kim, Kyung Ki

Robust architecture search using network adaptation Journal Article

In: Journal of Sensor Science and Technology, vol. 30, no. 5, pp. 290-294, 2021.

1644.

Yan, Kefan; Wang, Shunlong; Guan, Yuwei; Jiang, Ailian

TNAS: Neural Network Architecture Search Sampling Module Based on Variational Autoencoder Journal Article

In: CONVERTER, pp. 288-296, 2021.

1643.

Hao, Jie; Cai, Zhiling; Li, Ruijia; Zhu, William

Saliency: a new selection criterion of important architectures in neural architecture search Journal Article

In: Neural Computing and Applications, 2021.

1642.

Jia, Hong; Hu, Jiawei; Hu, Wen

SwingNet: Ubiquitous Fine-Grained Swing Tracking Framework via Stochastic Neural Architecture Search and Adversarial Learning Journal Article

In: Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., vol. 5, no. 3, 2021.

Abstract | Links | BibTeX

@article{10.1145/3478082,

title = {SwingNet: Ubiquitous Fine-Grained Swing Tracking Framework via Stochastic Neural Architecture Search and Adversarial Learning},

author = {Hong Jia and Jiawei Hu and Wen Hu},

url = {https://doi.org/10.1145/3478082},

doi = {10.1145/3478082},

year  = {2021},

date = {2021-09-01},

urldate = {2021-09-01},

journal = {Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.},

volume = {5},

number = {3},

publisher = {Association for Computing Machinery},

address = {New York, NY, USA},

abstract = {Sports analytics in the wild (i.e., ubiquitously) is a thriving industry. Swing tracking 

is a key feature in sports analytics. Therefore, a centimeter-level tracking resolution 

solution is required. Recent research has explored deep neural networks for sensor 

fusion to produce consistent swing-tracking performance. This is achieved by combining 

the advantages of two sensor modalities (IMUs and depth sensors) for golf swing tracking. 

Here, the IMUs are not affected by occlusion and can support high sampling rates. 

Meanwhile, depth sensors produce significantly more accurate motion measurements than 

those produced by IMUs. Nevertheless, this method can be further improved in terms 

of accuracy and lacking information for different domains (e.g., subjects, sports, 

and devices). Unfortunately, designing a deep neural network with good performance 

is time consuming and labor intensive, which is challenging when a network model is 

deployed to be used in new settings. To this end, we propose a network based on Neural 

Architecture Search (NAS), called SwingNet, which is a regression-based automatic 

generated deep neural network via stochastic neural network search. The proposed network 

aims to learn the swing tracking feature for better prediction automatically. Furthermore, 

SwingNet features a domain discriminator by using unsupervised learning and adversarial 

learning to ensure that it can be adaptive to unobserved domains. We implemented SwingNet 

prototypes with a smart wristband (IMU) and smartphone (depth sensor), which are ubiquitously 

available. They enable accurate sports analytics (e.g., coaching, tracking, analysis 

and assessment) in the wild.Our comprehensive experiment shows that SwingNet achieves 

less than 10 cm errors of swing tracking with a subject-independent model covering 

multiple sports (e.g., golf and tennis) and depth sensor hardware, which outperforms 

state-of-the-art approaches.},

keywords = {},

pubstate = {published},

tppubtype = {article}

}

1641.

Cazasnoves, Anthony; Ganaye, Pierre-Antoine; Sanchis, Kévin; Ceillier, Tugdual

Neural Architecture Search in operational context: a remote sensing case-study Technical Report

Preligens 2021.

1640.

Yang, Xin; Fan, Jiangfeng; Wu, Chenhuan; Zhou, Dake; Li, Tao

NasmamSR: a fast image super-resolution network based on neural architecture search and multiple attention mechanism Journal Article

In: Multimedia Systems (2021), 2021.

1639.

Wendlinger, Lorenz; Berndl, Emanuel; Granitzer, Michael

Methods for Automatic Machine-Learning Workflow Analysis Proceedings Article

In: ECML PKDD 2021, 2021.

1638.

Zhao, Zimin; Kang, Ying; Hou, Aiqin; Gan, Daguang

SP-DARTS: Synchronous Progressive Differentiable Neural Architecture Search for Image Classification Journal Article

In: IEICE TRANSACTIONS on Information and Systems , vol. E104-D , no. 8 , pp. 1232-1238, 2021, ISBN: 1745-1361.

1637.

Ding, Yuhui; Yao, Quanming; Zhao, Huan; Zhang, Tong

DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks Proceedings Article

In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery &amp$mathsemicolon$ Data Mining, ACM, 2021.

1636.

Zhu, Yanming; Meijering, Erik

Automatic Improvement of Deep Learning Based Cell Segmentation in Time-Lapse Microscopy by Neural Architecture Search Journal Article

In: Bioinformatics, 2021.

1635.

Zhao, Jiejie; Lv, Weifeng; Du, Bowen; Ye, Junchen; Sun, Leilei; Xiong, Guixi

Deep multi-task learning with flexible and compact architecture search Journal Article

In: International Journal of Data Science and Analytics , 2021.

1634.

Nguyen, Vu; Le, Tam; Yamada, Makoto; Osborne, Michael A

Optimal Transport Kernels for Sequential and Parallel Neural Architecture Search Proceedings Article

In: Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, 2021.

1633.

Ünal, Hamit Taner; Başçiftçi, Fatih

Evolutionary design of neural network architectures: a review of three decades of research Journal Article

In: Artificial Intelligence Review, 2021.

1632.

Dimanov, Daniel; Balaguer-Ballester, Emili; Singleton, Colin; Rostami, Shahin

Moncae: Multi-Objective Neuroevolution of Convolutional Autoencoders Proceedings Article

In: 2nd Workshop on Neural Architecture Search at ICLR 2021, 2021.

1631.

Lin, Yi; Liu, Yanfei; Liu, Jingguang; Liu, Guocai; Ma, Kai; Zheng, Yefeng

LE-NAS: Learning-based Ensemble with Neural Architecture Search for 3D Radiotherapy Dose Prediction Journal Article

In: 2021.

3280 entries « ‹ 33 of 66 › »