Physics-guided deep learning improves CFD for bubbly flow simulations.
problem Accurate CFD prediction of two-phase bubbly flow with high computational efficiency.
method Developed a multi-scale framework with Feature Similarity Measurement (FSM) for error estimation and a physics-guided deep feedforward neural network (DFNN) surrogate model.
result Physics-guided deep learning achieves comparable accuracy to fine-mesh simulations with fast-running feature.
Physics-guided model improves deep learning for nonlinear systems.
problem Intractable inference of nonlinear dynamical systems from data.
method Physics-guided Deep Markov Model (PgDMM) using neural networks.
result Improved performance on nonlinear systems with structured latent space.
Physics-guided neural network improves power flow analysis.
problem Infeasibility of traditional numerical approaches due to outdated or unavailable PF equations.
method Proposes a physics-guided neural network to learn PF mappings from historical data while constraining by physical laws.
result Physics-guided neural network achieves better performance and generalizability than unconstrained data-driven approaches.
FEA-Net uses physics knowledge to predict material responses efficiently.
problem Predicting material mechanical responses accurately and efficiently.
method Physics-guided deep learning with FEA integration.
result FEA-Net accurately predicts mechanical responses under external loading.
PhyDNN uses physics knowledge to improve drag force prediction models.
problem Complex physical processes in fluid dynamics are hard to model accurately.
method Physics-guided structural priors and aggregate supervision for deep learning.
result PhyDNN achieves a significant 8.46% improvement in drag force prediction.
PGA neural network improves uncertainty quantification in lake temperature modeling.
problem Quantifying uncertainties in lake temperature models while maintaining physical consistency.
method Integrates physical constraints into neural networks using Monte Carlo Dropout.
result Ensures better generalizability and physical consistency in MC estimates.
CoPhy-PGNN tackles competing PG losses in neural networks for solving eigenvalue problems.
problem Solving eigenvalue problems with competing physics-guided loss functions.
method Learning generalizable solutions using a novel approach to handle competing PG losses.
result Demonstrates the effectiveness of the approach in quantum mechanics and electromagnetic propagation.
Physics-guided reinforcement learning optimizes swimming in turbulent flows.
problem Optimizing swimming efforts to maintain proximity in turbulent environments.
method Physics-informed actor-physicist reinforcement learning algorithm.
result Physics-informed reinforcement learning outperforms standard methods in turbulent flow control.
Physen-Noise2Noise tackles defocus deblurring in low-light conditions with physics-guided self-supervised learning.
problem Defocus deblurring in low-light conditions with complex biased noise.
method Physics-guided self-supervised deblurring framework that leverages noisy multi-frame observations and a learnable noise bias parameter.
result Physen-Noise2Noise consistently outperforms state-of-the-art methods in defocus deblurring with complex biased noise.
This paper introduces a framework for combining scientific knowledge of physics-based models with neural networks to advance scientific discovery. This framework, termed physics-guided neural networks (PGNN), leverages the output of physics-based model simulations along with observational features in a hybrid modeling …
Self-supervised method enhances ultrasound images without needing clean targets.
problem Multiplicative speckle, acquisition blur, and scanner artifacts hamper ultrasound interpretation.
method Physics-guided degradation model trained on rotated/cropped patches with synthesized inputs.
result Achieves highest PSNR/SSIM across Gaussian and speckle noise levels, with significant improvements in heavy noise conditions.
Method reduces model bias in water temperature prediction using physics-guided GNNs.
problem Model bias in traditional physics-based models across different income and education levels.
method Physics-guided GNNs with refined neighbor selection and weights.
result Preserves equitable performance across different sensitive groups in the Delaware River Basin.
Paper integrates ML with physics models for engineering and environmental challenges.
problem Complex science and engineering problems require new methodologies combining physics-based models and ML.
method Structured overview of integrating physics-based models with ML techniques.
result Taxonomy of existing techniques and potential research gaps identified.
In this paper, we introduce a novel framework for combining scientific knowledge within physics-based models and recurrent neural networks to advance scientific discovery in many dynamical systems. We will first describe the use of outputs from physics-based models in learning a hybrid-physics-data model. Then, we furt…
Improves deep learning robustness by considering task and model.
problem Adversarial attacks on deep learning systems.
method Binary and interval label encoding strategy to redefine classification tasks and design corresponding loss functions.
result Our method enhances robustness without sacrificing accuracy.
Probabilistic deep learning uses neural networks and models to handle uncertainty.
problem Handling uncertainty in deep learning models.
method Two approaches: probabilistic neural networks and deep probabilistic models.
result TensorFlow Probability library supports both approaches.
This paper presents a basic property of region dividing of ReLU (rectified linear unit) deep learning when new layers are successively added, by which two new perspectives of interpreting deep learning are given. The first is related to decision trees and forests; we construct a deep learning structure equivalent to a …
The great success of deep learning shows that its technology contains profound truth, and understanding its internal mechanism not only has important implications for the development of its technology and effective application in various fields, but also provides meaningful insights into the understanding of human brai…
This paper provides an overview of deep semi-supervised learning methods.
problem Reducing the need for large annotated datasets in deep learning.
method Summarizes dominant semi-supervised approaches in deep learning.
result Provides a comprehensive overview of deep semi-supervised learning.
NeurIPS 2020 competition seeks to predict deep learning generalization.
problem Understanding and predicting generalization in deep learning models.
method Propose complexity measures to accurately predict generalization performance.
result A robust complexity measure could improve deep learning reliability.
This paper analyzes generalization issues in deep reinforcement learning.
problem Understanding and improving generalization capabilities of deep reinforcement learning policies.
method Formalizing and categorizing solutions to address overfitting in deep reinforcement learning.
result A comprehensive analysis of generalization challenges and solutions in deep reinforcement learning.
Deep learning is increasingly being used in high-stake decision making applications that affect individual lives. However, deep learning models might exhibit algorithmic discrimination behaviors with respect to protected groups, potentially posing negative impacts on individuals and society. Therefore, fairness in deep…
Deep learning is very effective at jointly learning feature representations and classification models, especially when dealing with high dimensional input patterns. Probabilistic logic reasoning, on the other hand, is capable to take consistent and robust decisions in complex environments. The integration of deep learn…
Deep-RLS uses deep learning to improve PCA for better source separation.
problem Improving PCA for better source separation in nonlinear systems.
method Inspired by RLS, Deep-RLS unfolds RLS iterations into a deep neural network.
result Deep-RLS significantly improves accuracy in recovering source signals.
How to understand deep learning systems remains an open problem. In this paper we propose that the answer may lie in the geometrization of deep networks. Geometrization is a bridge to connect physics, geometry, deep network and quantum computation and this may result in a new scheme to reveal the rule of the physical w…
Deep active inference learns policies from sensory inputs.
problem Learning policies in partially observable domains.
method Optimizes expected free energy with a variational autoencoder.
result Comparable or better performance than deep Q-learning.
Deep learning improves asset pricing and risk premium measurement.
problem Improving asset pricing and risk premium measurement using deep learning.
method Investigates various deep learning methods for asset pricing, especially for risk premia measurement.
result RNNs with memory mechanism and attention have the best performance in terms of predictivity.
Deep Learning is one of the newest trends in Machine Learning and Artificial Intelligence research. It is also one of the most popular scientific research trends now-a-days. Deep learning methods have brought revolutionary advances in computer vision and machine learning. Every now and then, new and new deep learning t…
Proposes model-based robust deep learning to handle natural variation in data.
problem Deep learning's fragility to natural variation in data.
method Develops model-based robust training algorithms using deep generative models to learn natural variation.
result Deep neural networks trained with model-based algorithms outperform standard and norm-bounded robust algorithms.
Deep nets with massive data learn spatially sparse functions.
problem Understanding the importance of massive data in deep learning.
method Established a sampling theorem and proved optimal learning rates.
result Massive data is crucial for deep nets to learn spatially sparse functions.
In this work we propose a new deep learning tool called deep dictionary learning. Multi-level dictionaries are learnt in a greedy fashion, one layer at a time. This requires solving a simple (shallow) dictionary learning problem, the solution to this is well known. We apply the proposed technique on some benchmark deep…
Bayesian deep learning improves deep learning's capabilities across diverse settings.
problem Overlooked metrics, tasks, and data types in deep learning.
method Revisits strengths of Bayesian deep learning and addresses challenges.
result Bayesian deep learning can elevate deep learning's capabilities across diverse settings.
Deep RL applied for Indian stock trading strategies.
problem Designing profitable trading strategies for Indian stock markets.
method Applied deep reinforcement learning to ten Indian stock datasets.
result Models' performance compared and evaluated.
Deep learning aids causal inference in complex settings.
problem Estimating heterogeneous treatment effects in non-linear, time-varying, and encoded confounders.
method Intuitive introduction to deep learning and causal inference, focusing on observational data.
result Maximizes accessibility to causal inference through deep learning.
Deep learning has emerged as a powerful machine learning technique that learns multiple layers of representations or features of the data and produces state-of-the-art prediction results. Along with the success of deep learning in many other application domains, deep learning is also popularly used in sentiment analysi…
Multimodal deep learning improves flaw detection in software programs.
problem Current flaw detection relies on single software representations.
method Adapted multimodal deep learning models for flaw detection.
result Multimodal models outperform traditional deep learning models.
Deep learning methods are reviewed for preserving structure in neural networks.
problem Challenges in applying deep learning, especially in preserving structure.
method Review of existing deep learning methods and new algorithmic frameworks.
result Mathematical understanding and systematic design of deep learning methods to preserve structure.
Characterizes deep neural network weight space for adversarial attacks.
problem Poor performance of deep learning models in adversarial examples.
method Characterizes deep neural network solution space using two paradigms.
result Adversarial attacks are less successful against Associative Memory Models.
Paper tackles interpretability issues in deep learning models.
problem Lack of understanding of deep learning models' decision-making processes.
method Integrates concepts from machine learning, quantum computation, and quantum field theory.
result Demonstrates a many valued quantum logic system in Convolutional Deep Belief Networks.
New framework tackles deep learning issues like local traps and miscalibration.
problem Local traps and miscalibration in deep neural networks.
method Sparse deep learning framework with prior annealing algorithms.
result Proposed method successfully addresses local traps and miscalibration.
Bayesian methods enhance deep learning models by improving reliability and uncertainty.
problem Improving reliability and uncertainty awareness in deep learning models.
method Approximate Bayesian inference techniques, including SG-MCMC and VI, applied to deep learning models.
result Enhanced posterior inference for deep learning models, particularly in neural networks and generative models.
Paper uses deep reinforcement learning for optimal stock portfolio management.
problem Optimizing stock portfolio choices in complex market environments.
method Direct deep reinforcement learning to learn factor representations and make optimal decisions.
result Deep learning outperforms average market performance in portfolio allocation.
Unified deep metric learning approach using neural networks.
problem Learning embeddings of data and extending Euclidean distances.
method Deep Bregman divergences based on neural networks.
result Superior performance on benchmark datasets compared to existing methods.
Deep learning applied to SAR data is explored in this paper.
problem Limited use of deep learning in SAR data processing.
method Introduction to relevant deep learning models, analysis of SAR data characteristics, review of state-of-the-art applications, and future research directions.
result Unlocking the potential of deep learning in SAR data processing.
Statistical field theory aids in understanding deep learning complexities.
problem Complexity and lack of theoretical understanding in deep learning.
method Statistical field theory as a theoretical framework.
result Field theory provides insights into generalization, bias, and feature learning.
Theoretical analysis improves understanding of Deep Q-Learning's behavior.
problem Lack of formal guarantees and gaps between theory and practice of Deep Q-Learning.
method Dynamical systems perspective, focusing on realistic assumptions.
result Proves convergence of Deep Q-Learning under specific conditions.
SDF adapts Deep Forest for evolving data streams with active learning.
problem Adapting Deep Forest for evolving data streams.
method Streaming Deep Forest (SDF) with Augmented Variable Uncertainty (AVU) active learning.
result SDF with AVU outperforms other methods trained with all instances by 70% labeling budget.
Deep kernel learning combines the non-parametric flexibility of kernel methods with the inductive biases of deep learning architectures. We propose a novel deep kernel learning model and stochastic variational inference procedure which generalizes deep kernel learning approaches to enable classification, multi-task lea…