A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
PGA neural network improves uncertainty quantification in lake temperature modeling.
FEA-Net uses physics knowledge to predict material responses efficiently.
Physics-guided deep learning improves CFD for bubbly flow simulations.
Physics-guided neural network improves power flow analysis.
PhyDNN uses physics knowledge to improve drag force prediction models.
Physics-guided model improves deep learning for nonlinear systems.
This paper introduces a framework for combining scientific knowledge of physics-based models with neural networks to advance scientific discovery. This framework, termed physics-guided neural networks (PGNN), leverages the output of physics-based model simulations along with observational features in a hybrid modeling …
CoPhy-PGNN tackles competing PG losses in neural networks for solving eigenvalue problems.
Physen-Noise2Noise tackles defocus deblurring in low-light conditions with physics-guided self-supervised learning.
Physics-guided reinforcement learning optimizes swimming in turbulent flows.
Self-supervised method enhances ultrasound images without needing clean targets.
Method reduces model bias in water temperature prediction using physics-guided GNNs.
Paper integrates ML with physics models for engineering and environmental challenges.
In this paper, we introduce a novel framework for combining scientific knowledge within physics-based models and recurrent neural networks to advance scientific discovery in many dynamical systems. We will first describe the use of outputs from physics-based models in learning a hybrid-physics-data model. Then, we furt…
Proposes a method to improve neural architectures reproducibly.
Simpler neural architecture search method using random architectures and regression.
NAT optimizes neural architectures to improve performance without extra cost.
DNAS disentangles neural architecture search for better interpretability and performance.
Conventional Neural Architecture Search (NAS) aims at finding a single architecture that achieves the best performance, which usually optimizes task related learning objectives such as accuracy. However, a single architecture may not be representative enough for the whole dataset with high diversity and variety. Intuit…
The use of automatic methods, often referred to as Neural Architecture Search (NAS), in designing neural network architectures has recently drawn considerable attention. In this work, we present an efficient NAS approach, named HM- NAS, that generalizes existing weight sharing based NAS approaches. Existing weight shar…
Study reduces NAS search cost by generating multiple complex architectures in one shot.
SGAS improves neural architecture search by choosing and pruning operations greedily.
Deep learning models' architectures, including depth and width, are key factors influencing models' performance, such as test accuracy and computation time. This paper solves two problems: given computation time budget, choose an architecture to maximize accuracy, and given accuracy requirement, choose an architecture …
Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years. However, few efforts have been devoted to understanding the generated architectu…
DNArch learns CNN architectures by backpropagation.
Differentially-private FNAS protects privacy while collaboratively searching for neural architectures.
PDNAS optimizes GNN architectures for diverse datasets.
A graph VAE framework optimizes neural architectures in a continuous space.
Neural architecture search (NAS) is gaining more and more attention in recent years due to its flexibility and remarkable capability to reduce the burden of neural network design. To achieve better performance, however, the searching process usually costs massive computations that might not be affordable for researcher…
Neural architecture search has been shown to hold great promise towards the automation of deep learning. However in spite of its potential, neural architecture search remains quite costly. To this point, we propose a novel gradient-based framework for efficient architecture search by sharing information across several …
Bayesian optimization reduces RNN architecture search time.
GATES improves neural architecture search by modeling operations as information transformation.
The process of designing neural architectures requires expert knowledge and extensive trial and error. While automated architecture search may simplify these requirements, the recurrent neural network (RNN) architectures generated by existing methods are limited in both flexibility and components. We propose a domain-s…
In neural architecture search, the structure of the neural network to best model a given dataset is determined by an automated search process. Efficient Neural Architecture Search (ENAS), proposed by Pham et al. (2018), has recently received considerable attention due to its ability to find excellent architectures with…
A ranking network improves neural architecture search efficiency.
SemiNAS reduces NAS cost by predicting accuracy of unlabeled architectures.
This paper addresses the scalability challenge of architecture search by formulating the task in a differentiable manner. Unlike conventional approaches of applying evolution or reinforcement learning over a discrete and non-differentiable search space, our method is based on the continuous relaxation of the architectu…
The ability to rank candidate architectures is the key to the performance of neural architecture search~(NAS). One-shot NAS is proposed to reduce the expense but shows inferior performance against conventional NAS and is not adequately stable. We investigate into this and find that the ranking correlation between archi…
Generative Adversarial Networks (GANs) are a powerful class of generative models. Despite their successes, the most appropriate choice of a GAN network architecture is still not well understood. GAN models for image synthesis have adopted a deep convolutional network architecture, which eliminates or minimizes the use …
New model predicts neural network performance from early training epochs, incorporating architecture impact.
Gradient-based method prunes large models to create transferable architectures.
Latest algorithms for automatic neural architecture search perform remarkable but are basically directionless in search space and computational expensive in training of every intermediate architecture. In this paper, we propose a method for efficient architecture search called EENA (Efficient Evolution of Neural Archit…
Recent studies on neural architecture search have shown that automatically designed neural networks perform as good as expert-crafted architectures. While most existing works aim at finding architectures that optimize the prediction accuracy, these architectures may have complexity and is therefore not suitable being d…
BNAS improves neural architecture search with a scalable, fast, and efficient approach.
FedNAS automates federated learning by searching for better architectures.
Deep neural network architectures have traditionally been designed and explored with human expertise in a long-lasting trial-and-error process. This process requires huge amount of time, expertise, and resources. To address this tedious problem, we propose a novel algorithm to optimally find hyperparameters of a deep n…
Graph neural networks (GNN) has been successfully applied to operate on the graph-structured data. Given a specific scenario, rich human expertise and tremendous laborious trials are usually required to identify a suitable GNN architecture. It is because the performance of a GNN architecture is significantly affected b…
Automatic neural architecture design has shown its potential in discovering powerful neural network architectures. Existing methods, no matter based on reinforcement learning or evolutionary algorithms (EA), conduct architecture search in a discrete space, which is highly inefficient. In this paper, we propose a simple…