AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


2464 entries « 49 of 50 »

2017

64.

Li, Lisha; Jamieson, Kevin G; DeSalvo, Giulia; Rostamizadeh, Afshin; Talwalkar, Ameet

Hyperband - A Novel Bandit-Based Approach to Hyperparameter Optimization Journal Article

In: vol. 18, pp. 185:1-185:52, 2017.

Links | BibTeX

2016

63.

Vu, Ngoc Thang; Adel, Heike; Gupta, Pankaj; Schütze, Hinrich

Combining Recurrent and Convolutional Neural Networks for Relation Classification Technical Report

2016.

Links | BibTeX

62.

Chen, Long; Zhang, Hanwang; Xiao, Jun; Nie, Liqiang; Shao, Jian; Liu, Wei; Chua, Tat-Seng

SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning Technical Report

2016.

Links | BibTeX

61.

Smithson, Sean C; Yang, Guang; Gross, Warren J; Meyer, Brett H

Neural networks designing neural networks - multi-objective hyper-parameter optimization Inproceedings

In: pp. 104, 2016.

Links | BibTeX

60.

Saxena, Shreyas; Verbeek, Jakob

Convolutional Neural Fabrics Inproceedings

In: pp. 4053-4061, 2016.

Links | BibTeX

59.

Loshchilov, Ilya; Hutter, Frank

CMA-ES for Hyperparameter Optimization of Deep Neural Networks Technical Report

2016.

Links | BibTeX

58.

Chen, Tianqi; Goodfellow, Ian J; Shlens, Jonathon

Net2Net - Accelerating Learning via Knowledge Transfer Inproceedings

In: 2016.

Links | BibTeX

57.

Chen, Justin

Combinatorially Generated Piecewise Activation Functions Technical Report

2016.

Links | BibTeX

2015

56.

Kulish, Vadym V; Malyi, Oleksandr I; Persson, Clas; Wu, Ping

Evaluation of Phosphorene as Anode Material for Na-ion Batteries from First Principles Technical Report

2015.

Links | BibTeX

55.

Young, Steven R; Rose, Derek C; Karnowski, Thomas P; Lim, Seung-Hwan; Patton, Robert M

Optimizing deep learning hyper-parameters through an evolutionary algorithm Inproceedings

In: pp. 4:1-4:5, 2015.

Links | BibTeX

2013

54.

Lopez, Pablo; Fernandez, David; Marin-Perez, Rafael; Jara, Antonio J; Gomez-Skarmeta, Antonio F

Scalable Oriented-Service Architecture for Heterogeneous and Ubiquitous IoT Domains Technical Report

2013.

Links | BibTeX

53.

Fister, Iztok; Jr., Iztok Fister; Yang, Xin-She; Brest, Janez

A comprehensive review of firefly algorithms Technical Report

2013.

Links | BibTeX

2012

52.

Anas, M; Javaid, N; Mahmood, A; Raza, S M; Qasim, U; Khan, Z A

Minimizing Electricity Theft using Smart Meters in AMI Technical Report

2012.

Links | BibTeX

51.

Snoek, Jasper; Larochelle, Hugo; Adams, Ryan P

Practical Bayesian Optimization of Machine Learning Algorithms Inproceedings

In: pp. 2960-2968, 2012.

Links | BibTeX

2009

50.

Jaffres-Runser, Katia; Gorce, Jean-Marie; Comaniciu, Cristina

A multiobjective Tabu framework for the optimization and evaluation of wireless systems Technical Report

2009.

Links | BibTeX

49.

Stanley, Kenneth O; D'Ambrosio, David B; Gauci, Jason

A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks Journal Article

In: vol. 15, no. 2, pp. 185-212, 2009.

Links | BibTeX

2008

48.

Floreano, Dario; Dürr, Peter; Mattiussi, Claudio

Neuroevolution - from architectures to learning Journal Article

In: vol. 1, no. 1, pp. 47-62, 2008.

Links | BibTeX

2005

47.

Czarnowski, Ireneusz; Jedrzejowicz, Piotr

An Agent-Based PLA for the Cascade Correlation Learning Architecture Inproceedings

In: pp. 197-202, 2005.

Links | BibTeX

2004

46.

Roy, N K; Potter, Walter D; Landau, D P

Designing Polymer Blends Using Neural Networks, Genetic Algorithms, and Markov Chains Journal Article

In: vol. 20, no. 3, pp. 215-229, 2004.

Links | BibTeX

1994

45.

Angeline, Peter J; Saunders, Gregory M; Pollack, Jordan B

An evolutionary algorithm that constructs recurrent neural networks Journal Article

In: vol. 5, no. 1, pp. 54-65, 1994.

Links | BibTeX

1990

44.

Kitano, Hiroaki

Designing Neural Networks Using Genetic Algorithms with Graph Generation System Journal Article

In: vol. 4, no. 4, 1990.

Links | BibTeX

1988

43.

Tenorio, Manoel Fernando; Lee, Wei-Tsih

Self Organizing Neural Networks for the Identification Problem Inproceedings

In: pp. 57-64, 1988.

Links | BibTeX

0000

42.

Waris, Faisal; Reynolds, Robert G.; Lee, Joonho

Evolving Deep Neural Networks with Cultural Algorithms for Real-Time Industrial Applications Journal Article

In: International Journal of Semantic Computing, vol. 0, no. 0, pp. 1-32, 0000.

Abstract | Links | BibTeX

41.

Simsek, Ozlem Imik; Alagoz, Baris Baykant

Optimal architecture artificial neural network model design with exploitative alpha gray wolf optimization for soft calibration of CO concentration measurements in electronic nose applications Journal Article

In: Transactions of the Institute of Measurement and Control, vol. 0, no. 0, pp. 01423312221119648, 0000.

Abstract | Links | BibTeX

40.

Soniya,; Singh, Lotika; Paul, Sandeep

Hybrid evolutionary network architecture search (HyENAS) for convolution class of deep neural networks with applications Journal Article

In: Expert Systems, vol. n/a, no. n/a, pp. e12690, 0000.

Abstract | Links | BibTeX

39.

Zhang, Bao Feng; Zhou, Guo Qiang

Control the number of skip-connects to improve robustness of the NAS algorithm Journal Article

In: IET Computer Vision, vol. n/a, no. n/a, 0000.

Abstract | Links | BibTeX

38.

Shashirangana, Jithmi; Padmasiri, Heshan; Meedeniya, Dulani; Perera, Charith; Nayak, Soumya R; Nayak, Janmenjoy; Vimal, Shanmuganthan; Kadry, Seifidine

License plate recognition using neural architecture search for edge devices Journal Article

In: International Journal of Intelligent Systems, vol. n/a, no. n/a, 0000.

Abstract | Links | BibTeX

37.

Wang, Xingbin; Zhao, Boyan; Hou, Rui; Awad, Amro; Tian, Zhihong; Meng, Dan

NASGuard: A Novel Accelerator Architecture for Robust Neural Architecture Search (NAS) Networks Inproceedings

In: 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA), 0000.

Links | BibTeX

36.

Zhang, Jianwei; Li, Dong; Wang, Lituan; Zhang, Lei

One-Shot Neural Architecture Search by Dynamically Pruning Supernet in Hierarchical Order Journal Article

In: International Journal of Neural Systems, 0000, (PMID: 34128778).

Abstract | Links | BibTeX

35.

Li, Xiao; Lei, Lin; Kuang, Gangyao

Multi-Modal Fusion Architecture Search for Land over Classification using Heterogeneous Remote Sensing Images Technical Report

0000.

Links | BibTeX

34.

Sapra, Dolly; Pimentel, Andy D.

Designing convolutional neural networks with constrained evolutionary piecemeal training Journal Article

In: Applied Intelligence , 0000.

Links | BibTeX

33.

Artin, Javad; Valizadeh, Amin; Ahmadi, Mohsen; Kumar, Sathish A. P.; Sharifi, Abbas

Presentation of a Novel Method for Prediction of Traffic with Climate Condition Based on Ensemble Learning of Neural Architecture Search (NAS) and Linear Regression Journal Article

In: Complexity, 0000.

Abstract | Links | BibTeX

32.

Gong, Yunhong; Sun, Yanan; Peng, Dezhong; Chen, Peng; Yan, Zhongtai; Yang, Ke

Analyze COVID-19 CT images based on evolutionary algorithm with dynamic searching space Journal Article

In: Complex & Intelligent Systems , 0000.

Links | BibTeX

31.

Cheng, Hsin-Pai

Efficient and Generalizable Neural Architecture Search for Visual Recognition PhD Thesis

0000.

Links | BibTeX

30.

Zhu, Xunyu; Li, Jian; Liu, Yong; Liao, Jun; Wang, Weiping

Operation-level Progressive Differentiable Architecture Search Technical Report

0000.

Links | BibTeX

29.

Huang, Sian-Yao; Chu, Wei-Ta

OSNASLib: One-Shot NAS Library Inproceedings

In: ICCV 2021 Workshop on Neural Architectures: Past, Present and Future, 0000.

Links | BibTeX

28.

Madhu, G.; Bharadwaj, B. Lalith; Boddeda, Rohit; Vardhan, Sai; Kautish, K. Sandeep; Alnowibet, Khalid; Alrasheedi, Adel F.; Mohamed, Ali Wagdy

Deep Stacked Ensemble Learning Model for COVID-19 Classification Technical Report

0000.

Links | BibTeX

27.

Kandukuri, Nikhil; Sakhtivel, Sangeetha; Xie, Pengtao

Neural Architecture Search For Skin Cancer Detection Technical Report

0000.

Links | BibTeX

26.

Jiang, Yingying; Gan, Zhuoxin; Lin, Ke; A, Yong

AttNAS: Searching Attentions for Lightweight Semantic Segmentation Inproceedings

In: British Machine Vision Conference (BMVC) 2021, 0000.

Links | BibTeX

25.

Loni, Mohammad; Mousavi, Hamid; Riazati, Mohammad; Daneshtalab, Masoud; Sjödin, Mikael

TAS : Ternarized Neural Architecture Search for Resource-Constrained Edge Devices Inproceedings

In: Design, Automation and Test in Europe ConferenceDesign, Automation and Test in Europe Conference (DATE) 2022, ANTWERP, BELGIUM :, 0000.

Abstract | Links | BibTeX

24.

Ma, Zhiyuan; Yu, Wenting; Zhang, Peng; Huang, Zhi; Lin, Anni; Xia, Yan

LPI Radar Waveform Recognition Based on Neural Architecture Search Journal Article

In: Computational Intelligence and Neuroscience, vol. 2022, 0000.

Links | BibTeX

23.

Salam, Hanan; Manoranjan, Viswonathan; Jian, Jiang; Celiktutan, Oya

Learning Personalised Models for Automatic Self-Reported Personality Recognition Technical Report

0000.

Links | BibTeX

22.

Dhanaraja, Mayur; Dob, Huyen; Nairb, Dinesh; Xub, Cong

Leveraging Tensor Methods in Neural Architecture Search for the automatic development of lightweight Convolutional Neural Networks Journal Article

In: 0000.

Links | BibTeX

21.

Yang, Chengrun; Bender, Gabriel; Liu, Hanxiao; Kindermans, Pieter-Jan; Udell, Madeleine; Lu, Yifeng; Le, Quoc; Huang, Da

TabNAS: Rejection Sampling for Neural Architecture Search on Tabular Datasets Technical Report

0000.

Links | BibTeX

20.

Hao, Yao; Zhang, Xizhe; Wang, Jie; Zhao, Tianyu; Sun, Baozhou

Improvement of IMRT QA prediction using imaging-based neural architecture search Journal Article

In: Medical Physics, vol. n/a, no. n/a, 0000.

Abstract | Links | BibTeX

19.

Zhai, Qihang; Li, Yan; Zhang, Zilin; Li, Yunjie; Wang, Shafei

Adaptive feature extraction and fine-grained modulation recognition of multi-function radar under small sample conditions Journal Article

In: IET Radar, Sonar & Navigation, vol. n/a, no. n/a, 0000.

Abstract | Links | BibTeX

18.

Wang, Ye-Qun; Li, Jian-Yu; Chen, Chun-Hua; Zhang, Jun; Zhan, Zhi-Hui

Scale adaptive fitness evaluation-based particle swarm optimisation for hyperparameter and architecture optimisation in neural networks and deep learning Journal Article

In: CAAI Transactions on Intelligence Technology, vol. n/a, no. n/a, 0000.

Abstract | Links | BibTeX

17.

Hu, Weifei; jinyi Shao,; Jiao, Qing; Wang, Chuxuan; Cheng, Jin; Liu, Zhenyu; Tan, Jianrong

A new differentiable architecture search method for optimizing convolutional neural networks in the digital twin of intelligent robotic grasping Journal Article

In: Journal of Intelligent Manufacturing, 0000.

Links | BibTeX

16.

Xue, Fanghui

Relaxation and Optimization for Automated Learning of Neural Network Architectures DISSERTATION PhD Thesis

0000.

Links | BibTeX

15.

Mokhtari, Nassim; Nédélec, Alexis; Gilles, Marlene; Loor, Pierre De

Improving Neural Architecture Search by Mixing a FireFly algorithm with a Training Free Evaluation Technical Report

0000.

BibTeX

2464 entries « 49 of 50 »