Skip to content

NiuTrans/NASPapers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

62 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Paper Lists of Neural Architecture Search

This document lists the papers published from 2017 to February 2021 on Neural Architecture Search (NAS). We collect these papers from 13 conferences and journals, including ACL、IJCAL、AAAI、JMLR、ICLR、EMNLP、CVPR、UAI、ICCV、NeurIPS、ECCV、INTERSPEECH、ICML with covering most NAS research directions. We also categorize these papers into popular topics and collect the code for them.

Outline

  • Code

    We find the code for some of the papers (if there are any). Parentheses in code links indicate that the code was not written by the author of the paper. (like (github))

  • Type

    We classify the papers according to their types and integrate the papers of the same type together. Please refer to the previous directory for specific classification criteria.

  • Task

    We summarize the tasks of these papers according to the experiments described in them. For notational simplicity, we use short names of the tasks (in alphabetical order).

    • ASR (Automatic Speech Recognition)
      • speech recognition
      • speaker verification
      • speaker identification
      • acoustic scene classification
      • keyword spotting
      • spoken language identification
      • multilingual speech recognition
    • CL
      • object classification
      • scene classification
      • point cloud classification
      • node classification
    • IC (Image Classification)
    • IR (Image Recognition)
    • IRT (Image ResToration)
      • image inpainting
      • image denoising
      • image de-raining
      • image restoration
    • LM (Language Model)
    • MT (Machine Translation)
    • NER (Named Entity Recognition)
    • O (Other)
    • OD (Object Detection)
    • SE
      • instance segmentation
      • OAR segmentation
    • SS (Semantic Segmentation)
    • VU (Video Understanding)
  • Info

    Info is an extension of the paper introduction, including Title, Author, Abstract and Bib.

  • A Short List

    For a quick look at the field, we summary a short list of must-read papers. In this section, we list some highly cited papers, and we also recommend some papers that may be helpful for beginners (bold).

Statistics

Figure 1: The number of each Type and annual amounts in recent four years.(See Outline for Type details)

Figure 2: The Number of papers in each Task area in recent years.(See Outline for Task details)

Figure 3: The word cloud for NAS.

A Short List

Title Type Task Code Year Info Citations
Learning Transferable Architectures for Scalable Image Recognition RL IC github 2018 details 2460
Neural Architecture Search with Reinforcement Learning RL IC LM - 2017 details 2434
DARTS: Differentiable Architecture Search G IC LM github 2018 details 1250
Efficient Neural Architecture Search via Parameter Sharing RL LM IC github 2018 details 1150
Regularized Evolution for Image Classifier Architecture Search EA IC - 2018 details 1071
Progressive Neural Architecture Search PD IC github 2018 details 953
MnasNet: Platform-Aware Neural Architecture Search for Mobile RL IC IR github 2018 details 887
Large-Scale Evolution of Image Classifiers EA IC - 2017 details 852
Designing Neural Network Architectures using Reinforcement Learning RL IC github 2017 details 756
Neural architecture search: A survey - - - 2018 details 736
ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware RL/G IC github 2019 details 656
Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization PD IC - 2017 details 647
Searching for MobileNetV3 O IC OD SS (github) 2019 details 617
Hierarchical Representations for Efficient Architecture Search EA IC - 2018 details 487
Genetic CNN EA IC (github) 2017 details 418
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search G IC github 2019 details 412
Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation G SS gitHub 2019 details 392
SMASH: One-Shot Model Architecture Search through HyperNetworks G IC github 2018 details 375
SNAS: stochastic neural architecture search G IC github 2019 details 366
A Genetic Programming Approach to Designing Convolutional Neural Network Architectures EA IC github 2018 details 343
Neural Architecture Optimization G IC LM github 2018 details 301
Understanding and Simplifying One-Shot Architecture Search G IC - 2018 details 290
Neural Architecture Search with Bayesian Optimisation and Optimal Transport BO IC github 2018 details 234
Practical Block-wise Neural Network Architecture Generation RL IC - 2018 details 227
Random Search and Reproducibility for Neural Architecture Search G IC LM github 2019 details 224
Searching for efficient multi-scale architectures for dense image prediction SP IR - 2018 details 215
Single Path One-Shot Neural Architecture Search with Uniform Sampling EA IC github 2020 details 174
Once for All: Train One Network and Specialize it for Efficient Deployment G IC OD github 2020 details 150
The Evolved Transformer RL LM MT - 2019 details 144
Neural Network Intelligence System - github - - -

A Long List

1 Surveys - S

Title Venue Code Year Info
Neural architecture search: A survey JMLR - 2018 details
A Survey on Neural Architecture Search - - 2019 details
Reinforcement Learning for Neural Architecture Search: A Review IVC - 2019 details
A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions - - 2020 details
Evaluating The Search Phase of Neural Architecture Search ICLR github 2020 details
NAS evaluation is frustratingly hard ICLR github 2020 details
AutoML: A survey of the state-of-the-art. Knowl Based Syst - 2021 -

2 Methods

2.1 Search Space - SP

Title Venue Task Code Year Info
GitGraph - from Computational Subgraphs to Smaller Architecture Search Spaces ICLR - - 2018 details
Searching for efficient multi-scale architectures for dense image prediction NeurIPS IR - 2018 details
Towards modular and programmable architecture search NeurIPS - github 2019 details
MFAS: Multimodal Fusion Architecture Search CVPR VU - 2019 details
NAS-Bench-101: Towards Reproducible Neural Architecture Search ICML IC github 2019 details
Auto-ReID: Searching for a Part-Aware ConvNet for Person Re-Identification ICCV IR - 2019 details
Exploring Randomly Wired Neural Networks for Image Recognition ICCV IC OD (github) 2019 details
NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search ICLR - github 2020 details
NAS-BENCH-201: Extending the Scope of Reproducible Neural Architecture Search ICLR IC github 2020 details
AutoShrink: A Topology-aware NAS for Discovering Efficient Neural Architecture AAAI IC LM github 2020 details
TextNAS: A Neural Architecture Search Space tailored for Text Representation AAAI O github 2020 details
Angle-based Search Space Shrinking for Neural Architecture Search ECCV IC - 2020 details
Graph-Guided Architecture Search for Real-Time Semantic Segmentation CVPR SS - 2020 details
MnasFPN : Learning Latency-aware Pyramid Architecture for Object Detection on Mobile Devices CVPR OD - 2020 details
SP-NAS: Serial-to-Parallel Backbone Search for Object Detection CVPR OD - 2020 details
FENAS: Flexible and Expressive Neural Architecture Search EMNLP LM O - 2020 details
ISTA-NAS: Efficient and Consistent Neural Architecture Search by Sparse Coding NeurIPS IC github 2020 details
Neural Architecture Generator Optimization NeurIPS IC IR github 2020 details
CLEARER: Multi-Scale Neural Architecture Search for Image Restoration NeurIPS IRT github 2020 details
RandAugment: Practical Automated Data Augmentation with a Reduced Search Space NeurIPS IC github 2020 details
Evolved Speech-Transformer: Applying Neural Architecture Search to End-to-End Automatic Speech Recognition INTERSPEECH ASR - 2020 details
NAS-Bench-ASR: Reproducible Neural Architecture Search for Speech Recognition ICLR O - 2021 details
HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark ICLR IC github 2021 details

2.2 Search Strategy

2.2.1 Reinforcement Learning Methods - RL
Title Venue Task Code Year Info
Neural Architecture Search with Reinforcement Learning ICLR IC LM - 2017 details
Learning to Compose Domain-Specific Transformations for Data Augmentation NeurIPS IC O - 2017 details
N2N learning: Network to Network Compression via Policy Gradient Reinforcement Learning ICLR - - 2017 details
Designing Neural Network Architectures using Reinforcement Learning ICLR IC github 2017 details
Neural Optimizer Search with Reinforcement Learning ICML IC - 2017 details
Efficient Neural Architecture Search via Parameter Sharing ICML LM IC github 2018 details
Efficient Architecture Search by Network Transformation AAAI IC github 2018 details
A Flexible Approach to Automated RNN Architecture Generation ICLR MT - 2018 details
Learning Transferable Architectures for Scalable Image Recognition CVPR IC github 2018 details
Practical Block-wise Neural Network Architecture Generation CVPR IC - 2018 details
Path-Level Network Transformation for Efficient Architecture Search ICML IC github 2018 details
MnasNet: Platform-Aware Neural Architecture Search for Mobile CVPR IC IR github 2018 details
Faster Discovery of Neural Architectures by Searching for Paths in a Large Model ICLR LM IC - 2018 details
UNAS: Differentiable Architecture Search Meets Reinforcement Learning CVPR IC - 2018 details
Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cells CVPR SS IR github 2019 details
Reinforcement Learning for Neural Architecture Search: A Review ICV - - 2019 details
Can Weight Sharing Outperform Random Architecture Search? An Investigation With TuNAS CVPR IC IR - 2019 details
Continual and Multi-Task Architecture Search ACL O github 2019 details
AutoGAN: Neural Architecture Search for Generative Adversarial Networks ICCV IC github 2019 details
ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware ICLR IC github 2019 details
IRLAS: Inverse Reinforcement Learning for Architecture Search CVPR IC - 2019 details
RENAS: Reinforced Evolutionary Neural Architecture Search CVPR IC SS github 2019 details
AM-LFS: AutoML for Loss Function Search ICCV IC IR - 2019 details
NAT: Neural Architecture Transformer for Accurate and Compact Architectures NeurlPS IC github 2019 details
NSGANetV2: Evolutionary Multi-Objective Surrogate-Assisted Neural Architecture Search ECCV IC - 2020 details
S2DNAS: Transforming Static CNN Model for Dynamic Inference via Neural Architecture Search ECCV IC - 2020 details
Breaking the Curse of Space Explosion: Towards Efficient NAS with Curriculum Search ICML IC github 2020 details
NAS-FCOS: Fast Neural Architecture Search for Object Detection CVPR IC github 2020 details
Graph Neural Architecture Search IJCAI O github 2020 details
InstaNAS: Instance-aware Neural Architecture Search AAAI IC github 2020 details
Towards Oracle Knowledge Distillation with Neural Architecture Search AAAI IC - 2020 details
Sample-Efficient Automated Deep Reinforcement Learning ICLR - - 2021 details
2.2.2 Gradient-based Methods - G
Title Venue Task Code Year Info
DARTS: Differentiable Architecture Search ICLR IC LM github 2018 details
Understanding and Simplifying One-Shot Architecture Search ICML IC - 2018 details
SMASH: One-Shot Model Architecture Search through HyperNetworks ICLR IC github 2018 details
Neural Architecture Optimization NeurIPS IC LM github 2018 details
Differentiable Neural Network Architecture Search ICLR-W O - 2018 details
ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware ICLR IC github 2019 details
Graph HyperNetworks for Neural Architecture Search ICLR IC - 2019 details
SNAS: stochastic neural architecture search ICLR IC github 2019 details
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search CVPR IC github 2019 details
Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation CVPR SS gitHub 2019 details
AdversarialNAS: Adversarial Neural Architecture Search for GANs CVPR O github 2019 details
When NAS Meets Robustness: In Search of Robust Architectures against Adversarial Attacks CVPR O github 2019 details
Random Search and Reproducibility for Neural Architecture Search UAI IC LM github 2019 details
One-Shot Neural Architecture Search via Self-Evaluated Template Network ICCV IC github 2019 details
Efficient Forward Architecture Search NeurIPS IC LM github 2019 details
Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition EMNLP NER github 2019 details
Network Pruning via Transformable Architecture Search NeurIPS IC github 2019 details
XNAS: Neural Architecture Search with Expert Advice NeurIPS IC github 2019 details
NetTailor: Tuning the Architecture, Not Just the Weights CVPR O github 2019 details
Searching for A Robust Neural Architecture in Four GPU Hours CVPR IC LM github 2019 details
Progressive Differentiable Architecture Search: Bridging the Depth Gap Between Search and Evaluation ICCV IC github 2019 details
Customizable Architecture Search for Semantic Segmentation CVPR SS - 2019 details
Auto-FPN: Automatic Network Architecture Adaptation for Object Detection Beyond Classification ICCV OD - 2019 details
Meta Architecture Search NeurlPS IC github 2019 details
Efficient Neural Architecture Transformation Search in Channel-Level for Object Detection NeurlPS OD - 2019 details
DATA: Differentiable ArchiTecture Approximation NeurlPS IC LM SS github 2019 details
Adaptive Stochastic Natural Gradient Method for One-Shot Neural Architecture Search ICML IC IRT github 2019 details
BayesNAS: A Bayesian Approach for Neural Architecture Search ICML IC github 2019 details
MiLeNAS: Efficient Neural Architecture Search via Mixed-Level Reformulation CVPR IC github 2020 details
APQ: Joint Search for Network Architecture, Pruning and Quantization Policy CVPR IC github 2020 details
SGAS: Sequential Greedy Architecture Search CVPR IC CL github 2020 details
FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions CVPR IC github 2020 details
Block-wisely Supervised Neural Architecture Search with Knowledge Distillation CVPR IC github 2020 details
Overcoming Multi-Model Forgetting in One-Shot NAS with Diversity Maximization CVPR IC LM github 2020 details
Densely Connected Search Space for More Flexible Neural Architecture Search CVPR IC OD github 2020 details
Understanding Architectures Learnt by Cell-based Neural Architecture Search ICLR IC github 2020 details
PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search ICLR IC OD github 2020 details
FasterSeg: Searching for Faster Real-time Semantic Segmentation ICLR SS github 2020 details
AtomNAS: Fine-Grained End-to-End Neural Architecture Search ICLR IC OD SE github 2020 details
Fast Neural Network Adaptation via Parameter Remapping and Architecture Search ICLR SS OD github 2020 details
Learning Architectures from an Extended Search Space for Language Modeling ACL LM NER O - 2020 details
Are Labels Necessary for Neural Architecture Search? ECCV IC SS github 2020 details
BATS: Binary ArchitecTure Search ECCV IC - 2020 details
Stabilizing Differentiable Architecture Search via Perturbation-based Regularization ICML IC LM github 2020 details
Memory-Efficient Hierarchical Neural Architecture Search for Image Denoising CVPR IRT - 2020 details
All in One Bad Weather Removal Using Architectural Search CVPR IRT - 2020 details
Organ at Risk Segmentation for Head and Neck Cancer Using Stratified Learning and Neural Architecture Search CVPR SE - 2020 details
Neural Architecture Search for Lightweight Non-Local Networks CVPR IC SS github 2020 details
UNAS: Differentiable Architecture Search Meets Reinforcement Learning CVPR IC - 2020 details
MTL-NAS: Task-Agnostic Neural Architecture Search Towards General-Purpose Multi-Task Learning CVPR SS CL O github 2020 details
Hit-Detector: Hierarchical Trinity Architecture Search for Object Detection CVPR OD github 2020 details
DSNAS: Direct Neural Architecture Search Without Parameter Retraining CVPR IC github 2020 details
Meta-Learning of Neural Architectures for Few-Shot Learning CVPR IR - 2020 details
Understanding and Robustifying Differentiable Architecture Search ICLR IC LM O github 2020 details
CP-NAS: Child-Parent Neural Architecture Search for 1-bit CNNs IJCAI IC - 2020 details
DropNAS: Grouped Operation Dropout for Differentiable Architecture Search IJCAI IC github 2020 details
MergeNAS: Merge Operations into One for Differentiable Architecture Search IJCAI IC - 2020 details
SI-VDNAS: Semi-Implicit Variational Dropout for Hierarchical One-shot Neural Architecture Search IJCAI IC - 2020 details
M-NAS: Meta Neural Architecture Search AAAI IC - 2020 details
Posterior-Guided Neural Architecture Search AAAI IC github 2020 details
Binarized Neural Architecture Search AAAI IC - 2020 details
Neural Graph Embedding for Neural Architecture Search AAAI IC SS - 2020 details
Efficient Neural Architecture Search via Proximal Iterations AAAI IC LM github 2020 details
Neural Architecture Search for Keyword Spotting INTERSPEECH ASR - 2020 details
DARTS-ASR: Differentiable Architecture Search for Multilingual Speech Recognition and Adaptation INTERSPEECH ASR - 2020 details
Geometry-Aware Gradient Algorithms for Neural Architecture Search ICLR IC github 2021 details
Rethinking Architecture Selection in Differentiable NAS ICLR IC - 2021 details
DrNAS: Dirichlet Neural Architecture Search ICLR IC github 2021 details
Zero-Cost Proxies for Lightweight NAS ICLR IC ASR - 2021 details
DARTS-: Robustly Stepping out of Performance Collapse Without Indicators ICLR IC github 2021 details
Auto-Sizing the Transformer Network: Improving Speed, Efficiency, and Performance for Low-Resource Machine Translation WNGT MT github 2019 -
2.2.3 Evolutionary Algorithms - EA
Title Venue Task Code Year Info
Large-Scale Evolution of Image Classifiers ICML IC - 2017 details
Genetic CNN ICCV IC (github) 2017 details
Hierarchical Representations for Efficient Architecture Search ICLR IC - 2018 details
Regularized Evolution for Image Classifier Architecture Search AAAI IC - 2018 details
A Genetic Programming Approach to Designing Convolutional Neural Network Architectures IJCAI IC github 2018 details
Simple And Efficient Architecture Search for Convolutional Neural Networks ICLR IC - 2018 details
RENAS: Reinforced Evolutionary Neural Architecture Search CVPR IC SS github 2019 details
Efficient Multi-Objective Neural Architecture Search via Lamarckian Evolution ICLR IC - 2019 details
Partial Order Pruning: for Best Speed/Accuracy Trade-off in Neural Architecture Search CVPR IC github 2019 details
Resource Constrained Neural Network Architecture Search: Will a Submodularity Assumption Help? ICCV IC github 2019 details
Evolving Space-Time Neural Architectures for Videos ICCV VU github 2019 details
DetNAS: Backbone Search for Object Detection NeurlPS IC github 2019 details
CARS: Continuous Evolution for Efficient Neural Architecture Search CVPR IC github 2020 details
GreedyNAS: Towards Fast One-Shot NAS With Greedy Supernet CVPR IC - 2020 details
MemNAS: Memory-Efficient Neural Architecture Search With Grow-Trim Learning CVPR IC - 2020 details
C2FNAS: Coarse-to-Fine Neural Architecture Search for 3D Medical Image Segmentation CVPR SE - 2020 details
EcoNAS: Finding Proxies for Economical Neural Architecture Search CVPR IC - 2020 details
Improving One-Shot NAS by Suppressing the Posterior Fading CVPR IC - 2020 details
AssembleNet: Searching for Multi-Stream Neural Connectivity in Video Architectures ICLR VU - 2020 details
One-Shot Neural Architecture Search via Novelty Driven Sampling IJCAI IC LM github 2020 details
SM-NAS: Structural-to-Modular Neural Architecture Search for Object Detection AAAI IR - 2020 details
Ultrafast Photorealistic Style Transfer via Neural Architecture Search AAAI O github 2020 details
FENAS: Flexible and Expressive Neural Architecture Search EMNLP LM O - 2020 details
Evolutionary Algorithm Enhanced Neural Architecture Search for Text-Independent Speaker Verification INTERSPEECH ASR - 2020 details
Neural Architecture Search on Acoustic Scene Classification INTERSPEECH ASR - 2020 details
2.2.4 Bayesian Optimization - BO
Title Venue Task Code Year Info
Neural Architecture Search with Bayesian Optimisation and Optimal Transport NeurIPS IC github 2018 details
Learnable Embedding Space for Efficient Neural Architecture Compression ICLR IC github 2019 details
Posterior-Guided Neural Architecture Search AAAI IC github 2020 details
Bridging the Gap between Sample-based and One-shot Neural Architecture Search with BONAS NeurIPS IC github 2020 details
Interpretable Neural Architecture Search via Bayesian Optimisation with Weisfeiler-Lehman Kernels ICLR IC - 2021 details

2.3 Performance Prediction - PD

Title Venue Task Code Year Info
Learning Curve Prediction with Bayesian Neural Networks ICLR - - 2017 details
Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization ICLR IC - 2017 details
Accelerating Neural Architecture Search using Performance Prediction ICLR-W IC LM github 2018 details
Progressive Neural Architecture Search ECCV IC github 2018 details
A Flexible Approach to Automated RNN Architecture Generation ICLR LM MT - 2018 details
Multinomial Distribution Learning for Effective Neural Architecture Search ICCV IC github 2019 details
Learnable Embedding Space for Efficient Neural Architecture Compression ICLR IC github 2019 details
TAPAS: Train-less Accuracy Predictor for Architecture Search AAAI IC - 2019 details
Generative Teaching Networks: Accelerating Neural Architecture Search by Learning to Generate Synthetic Training Data ICML IC - 2020 details
Neural Architecture Search in a Proxy Validation Loss Landscape ICML IC - 2020 details
Rethinking Performance Estimation in Neural Architecture Search CVPR IC github 2020 details
A Semi-Supervised Assessor of Neural Architectures CVPR IC - 2020 details
GP-NAS: Gaussian Process Based Neural Architecture Search CVPR IC IR - 2020 details
BRP-NAS: Prediction-based NAS using GCNs NeurIPS IC - 2020 details

2.4 Others - O

Title Venue Task Code Year Info
Hyperparameter Optimization: A Spectral Approach NeurIPS-W IC github 2017 details
PPP-Net: Platform-aware Progressive Search for Pareto-optimal Neural Architectures ICLR IC - 2018 details
DeepArchitect: Automatically Designing and Training Deep Architectures ICLR IC github 2018 details
Fast and Practical Neural Architecture Search ICCV IC (github) 2019 details
Teacher Guided Architecture Search ICCV IC - 2019 details
Deep Active Learning with a Neural Architecture Search NeurIPS IC github 2019 details
Searching for MobileNetV3 ICCV IC OD SS (github) 2019 details
SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers NeurlPS IC - 2019 details
Constrained deep neural network architecture search for IoT devices accounting for hardware calibration NeurlPS IC - 2019 details
Transferable AutoML by Model Sharing over Grouped Datasets CVPR IC - 2019 details
AutoML Strategy Based on Grammatical Evolution: A Case Study about Knowledge Discovery from Text ACL O github 2019 details
Improving Keyword Spotting and Language Identification via Neural Architecture Search at Scale INTERSPEECH ASR github 2019 details
AutoSTR: Efficient Backbone Search for Scene Text Recognition ECCV O github 2020 details
GroSS: Group-Size Series Decomposition for Grouped Architecture Search ECCV IC - 2020 details
DA-NAS: Data Adapted Pruning for Efficient Neural Architecture Search ECCV IC O - 2020 details
Neural Predictor for Neural Architecture Search ECCV IC - 2020 details
Learning to Rank Learning Curves ICML O - 2020 details
AOWS: Adaptive and Optimal Network Width Search With Latency Constraints CVPR O github 2020 details
How to 0wn the NAS in Your Spare Time ICLR O github 2020 details
Neural Epitome Search for Architecture-Agnostic Network Compression ICLR IC github 2020 details
AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search IJCAI O - 2020 details
Neural Architecture Search using Deep Neural Networks and Monte Carlo Tree Search AAAI IC github 2020 details
NADS: Neural Architecture Distribution Search for Uncertainty Awareness ICML IC IR - 2020 details
Evaluating The Search Phase of Neural Architecture Search ICLR LM IC github 2020 details
NAS evaluation is frustratingly hard ICLR IC github 2020 details
Towards Fast Adaptation of Neural Architectures with Meta Learning ICLR IC github 2020 details
Adapting Neural Architectures Between Domains NeurIPS IC (github) 2020 details
Theory-Inspired Path-Regularized Differential Network Architecture Search NeurIPS IC github 2020 details
Semi-Supervised Neural Architecture Search NeurIPS IC (github) 2020 details
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? NeurIPS IC github 2020 details
Differentiable Neural Architecture Search in Equivalent Space with Exploration Enhancement NeurIPS IC - 2020 details
Understanding and Exploring the Network with Stochastic Architectures NeurIPS IC (github) 2020 details
Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search NeurIPS IC github 2020 details
A Study on Encodings for Neural Architecture Search NeurIPS IC github 2020 details
Hierarchical Neural Architecture Search for Deep Stereo Matching NeurIPS O github 2020 details
Firefly Neural Architecture Descent: a General Approach for Growing Neural Networks NeurIPS IC - 2020 details
Best Practices for Scientific Research on Neural Architecture Search JMLR - - 2020 details
AutoSpeech: Neural Architecture Search for Speaker Recognition INTERSPEECH ASR github 2020 details
Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective ICLR IC github 2021 details
Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets ICLR IC - 2021 details

3 Systems

Title Venue Code Year Info
Auto-Keras: An Efficient Neural Architecture Search System - github 2018 details
Neural Network Intelligence - github - -
AdaNet: A Scalable and Flexible Framework for Automatically Learning Ensembles ICML-W github 2019 details
Improving Keyword Spotting and Language Identification via Neural Architecture Search at Scale INTERSPEECH github 2019 details
Auto-Panoptic: Cooperative Multi-Component Architecture Search for Panoptic Segmentation NeurIPS github 2020 details
PyGlove: Symbolic Programming for Automated Machine Learning NeurIPS - 2020 github

Team Members

The project is maintained by

Yongyu Mu, Zefan Zhou, Zhongxiang Yan, Chi Hu, Yinqiao Li, Tong Xiao, and Jingbo Zhu

Natural Language Processing Lab., School of Computer Science and Engineering, Northeastern University

NiuTrans Research

For any questions, please feel free to contact us (heshengmo [at] foxmail [dot] com or li.yin.qiao.2012 [at] hotmail [dot] com)