MAGE optimizes policies using action gradients from model-based learning.
problem Lack of direct gradient information from critics in actor-critic methods.
method Model-based actor-critic algorithm that learns action-value gradient.
result MAGE outperforms model-free and model-based baselines on continuous control tasks.
Study on a pinning model with random walk increments, showing convergence to a critical disordered pinning measure.
problem Understanding the critical behavior of a disordered pinning model.
method Analyzing a disordered pinning model induced by a random walk with specific moment conditions, showing convergence to a limiting measure.
result Convergence of point-to-point partition functions to the critical disordered pinning measure in the critical window.
Smaller actor-critic models lead to performance degradation and overfitting, highlighting the critic's role in value underestimation.
problem Performance degradation and overfitting in actor-critic models with smaller actors.
method Broad empirical investigations and analyses of asymmetric actor-critic setups, exploring techniques to mitigate value underestimation.
result Value underestimation is a key cause of performance degradation in smaller actor-critic models, and the critic plays a crucial role in mitigating this.
Study shows wealth distribution tails near criticality are not universal.
problem Understanding wealth distribution tails near criticality.
method Generalized affine wealth model with nonconstant redistribution.
result Exponential tail near criticality is not universal; depends on redistribution policy.
Enhanced Sampling Scheme improves masked generative modeling.
problem Limitations of existing sampling schemes in masked non-autoregressive generative modeling.
method ESS consists of three stages: Naive Iterative Decoding, Critical Reverse Sampling, and Critical Resampling.
result ESS achieves significant performance gains in unconditional and class-conditional sampling.
Model criticism tool evaluates text coherence and structure in generated long-form text.
problem Evaluate the high-level structure of generated text for coherence, coreference, and topicality.
method Apply model criticism in latent space to compare real and generated data distributions.
result Transformer-based models struggle with maintaining structural coherence and coreference.
Model criticism is usually carried out by assessing if replicated data generated under the fitted model looks similar to the observed data, see e.g. Gelman, Carlin, Stern, and Rubin [2004, p. 165]. This paper presents a method for latent variable models by pulling back the data into the space of latent variables, and c…
ESAC improves reinforcement learning by lookahead and intuition.
problem Designing efficient reinforcement learning architectures for intelligent agents.
method Integrates selector, tuner, model-learner, estimator, and lookahead into ESAC.
result ESAC outperforms other architectures in optimizing policies.
This work aims to create a large-scale model for critical care time series data.
problem Lack of large-scale datasets and distribution shifts in critical care time series data.
method Harmonized dataset creation and transfer learning research.
result Established a foundation for large-scale multi-variate time series models in critical care.
Critical learning periods found in deep linear networks too.
problem Understanding why critical learning periods emerge in both biological and artificial networks.
method Focused on deep linear network models, analyzed depth and data distribution, and examined multi-task learning.
result Critical periods depend on model depth and data distribution structure, and pre-training can affect transfer performance.
A new method uses higher-order Langevin dynamics with critical damping for better generative modeling.
problem Improving generative models using Langevin dynamics with auxiliary variables.
method Introducing higher-order Langevin dynamics with critical damping, providing closed-form solutions.
result Improved generative models with better performance as measured by FID metric.
New result on critical points of Bethe free energy under deformation retracts.
problem Characterizing critical points of Bethe free energy for complex graphs.
method Analyzing homotopy types and deformation retracts of factor graphs.
result Critical points of Bethe free energy are invariant under deformation retracts.
New method improves off-policy critic evaluation in reinforcement learning.
problem High variance and instability in off-policy policy evaluation.
method Doubly robust estimators applied to actor-critic algorithms.
result Doubly robust estimation significantly improves performance in continuous control tasks.
CoRMF uses RNNs to solve Ising models efficiently by ordering critical edges.
problem Solving Ising models efficiently and accurately.
method Criticality-ordered spin sequence and RNNs for mean-field factorization.
result Proves tighter error bounds than naive mean-field.
Modeling financial markets as gas molecules, the paper predicts phase transitions similar to water and steam.
problem Understanding the dynamics of financial markets through phase transitions.
method Developed a lattice gas model equivalent to the Ising model on a social network, analyzing critical exponents and auto-correlations.
result Financial market dynamics exhibit phase transition-like behavior, with critical exponents analogous to water and steam.
A simple model economy with locally interacting producers and consumers is introduced. When driven by extremal dynamics, the model self-organizes {\em not} to an attractor state, but to an asymptote, on which the economy has a constant rate of deflation, is critical, and exhibits avalanches of activity with power-law d…
We discuss a simple model based on the Minority Game which reproduces the main stylized facts of anomalous fluctuations in finance. We present the analytic solution of the model in the thermodynamic limit and show that stylized facts arise only close to a line of critical points with non-trivial properties. By a simple…
New DL algorithm detects critical chest X-ray findings without manual annotations.
problem Lack of explainability and manual annotation costs for DL models in medical imaging.
method Multi-instance learning approach to jointly classify and localize critical findings in CXR.
result Competitive classification results on three CXR datasets.
Study shows flash crashes in finance are self-organized criticality events.
problem Understanding and predicting anomalous price events in high-frequency finance.
method Investigated volume distributions during flash crashes and linked them to self-organized criticality.
result Volume distributions during flash crashes indicate a diverging second moment, suggesting self-organized criticality.
Paper proves convex domains have one maximum for semi-stable solutions.
problem Analyzing critical points of semi-stable solutions on convex domains.
method Relating critical points to an auxiliary function and using topological degree.
result Positive, semi-stable solutions have exactly one non-degenerate critical point.
We disprove the generalized Chern-Hamilton conjecture on the existence of critical compatible metrics on contact 3-manifolds. More precisely, we show that a contact 3-manifold (M,α) admits a critical compatible metric for the Chern-Hamilton energy functional if and only if it is Sasakian or its associated Reeb fl…
CARL safely adapts RL agents for safety-critical tasks.
problem Safety hazards in RL for safety-critical tasks.
method CARL combines model-based RL and cautious adaptation.
result CARL achieves higher rewards with fewer failures in safety-critical tasks.
New testing method for robust actor-critic bandit algorithms.
problem Balancing data collection for app performance and user adherence.
method Modified actor-critic algorithm and novel testing procedure.
result Testing procedure is robust to critic misspecification.
Curiosity-Critic improves world model training by focusing on cumulative prediction error.
problem Training world models with intrinsic rewards that consider cumulative prediction error.
method Curiosity-Critic uses a surrogate reward based on the difference between current and asymptotic prediction errors, estimated online by a co-trained critic.
result Curiosity-Critic outperforms other methods in training speed and final world model accuracy.
DL models for MTS regression are vulnerable to adversarial attacks, posing risks in safety-critical applications.
problem Vulnerability of DL models to adversarial examples in MTS regression.
method Adversarial attack generation techniques from image classification were adapted for MTS.
result All state-of-the-art DL regression models (CNN, LSTM, GRU) are vulnerable to adversarial attacks.
TOLD++ improves convergence of diffusion models by critically damping the forward transition matrix.
problem Improving the convergence of Denoising Diffusion Probabilistic Models.
method Critically damping the Third-Order Langevin Dynamics (TOLD) forward transition matrix using eigen-analysis.
result TOLD++ converges faster than TOLD, verified on toy and real datasets.
Probabilistic modeling is a powerful approach for analyzing empirical information. We describe Edward, a library for probabilistic modeling. Edward's design reflects an iterative process pioneered by George Box: build a model of a phenomenon, make inferences about the model given data, and criticize the model's fit to …
TT-DAC-PS: A deterministic actor-critic approach for optimal trade execution
problem Optimal execution of large stock sell programs
method Twin-Target Deterministic Actor-Critic with Policy Smoothing
result Reduces mean implementation shortfall percentage
Actor-critic algorithms converge to an ODE as data samples change dynamically.
problem Challenging to mathematically analyze due to non-i.i.d. data samples.
method Proved convergence to an ODE using time rescaling and geometric ergodicity.
result Convergence to the ODE limit and its properties proven.
We analyze critical points of the Sliced Wasserstein Distance for optimization stability.
problem Understanding the behavior of optimization algorithms for models trained with the Sliced Wasserstein Distance.
method Explicit perturbations and critical point analysis of the SW objective.
result Stable critical points of SW cannot concentrate on segments, providing optimization stability.
Study on eigenfunctions on sphere configurations, proving non-existence and construction of critical eigensections.
problem Existence and rigidity of critical Z2 eigenvalues on sphere configurations.
method Algebraic identities and finite group representation theory.
result Construction of infinitely many configurations admitting critical eigensections and proof of deformation rigidity of Taubes-Wu tetrahedral eigensections.
Investigates multifractal scaling in critical dynamics of random surfaces.
problem Analyzing multifractal scaling in critical dynamics of random surfaces.
method Examined multifractal scaling in various conformal field theories on random surfaces.
result Higher moments of time variations of the order parameter exhibit multifractal scaling.
In real-world machine learning applications, data subsets correspond to especially critical outcomes: vulnerable cyclist detections are safety-critical in an autonomous driving task, and "question" sentences might be important to a dialogue agent's language understanding for product purposes. While machine learning mod…
Method analyzes complexity of empirical risk landscapes for generalized linear models.
problem Understanding the complexity of empirical risk landscapes in generalized linear models.
method Kac-Rice method and replicated method from theoretical physics.
result Explicit variational formulas for the number of critical points of empirical risk landscapes.
Study critical metrics on manifolds, proving specific isometries.
problem Investigating critical metrics on complete manifolds.
method Analyzing volume functional and proving isometries.
result Critical metrics on specific manifolds are isometric to standard models.
New critics improve VAEs by preventing latent collapse.
problem Posterior collapse in VAEs where latent variables are ignored.
method Inference critics that detect and incentivize meaningful latent representations.
result Optimizing inference critics increases mutual information between latent and observations.
Neural networks trained with actor-critic algorithms converge to ODEs under weak convergence analysis.
problem Challenges in convergence analysis due to changing data distributions in online learning.
method Geometric ergodicity of data samples, Poisson equation, weak convergence techniques.
result Actor and critic networks converge to solutions of ODEs with random initial conditions.
New method uses RBM flows to find critical temperatures in Ising models.
problem Detecting critical temperatures in RBM flows without model topology information.
method Iterative sampling from RBM mapped on Ising model temperature space using a neural network thermometer.
result Flow of RBM trained on Ising spin configurations approaches critical temperature around kBTc/J≈2.269. Progress of machine learning in critical care has been difficult to track, in part due to absence of public benchmarks. Other fields of research (such as computer vision and natural language processing) have established various competitions and public benchmarks. Recent availability of large clinical datasets has enabl…
Paper introduces a meta-critic for accelerating off-policy actor-critic learning.
problem Improving sample efficiency in continuous control tasks.
method Meta-critic that meta-learns an additional loss for the actor.
result Online meta-critic learning leads to improved performance in various continuous control environments.
FORK improves model-free reinforcement learning performance.
problem Improving model-free reinforcement learning performance.
method Introducing a new forward-looking Actor (FORK) for Actor-Critic algorithms.
result FORK significantly improves performance in various environments.
A neural network model predicts the critical point of the Ising phase transition.
problem Predicting the critical point of the Ising phase transition using supervised learning.
method Proposed a minimal one-free-parameter neural network model to describe the supervised learning problem for the Ising model.
result Just one free parameter is enough to describe the universal finite-size-scaling function in the network output.
A new sampler tackles critical phenomena by leveraging scale invariance.
problem Scale invariance at criticality causes sampling difficulties in Monte Carlo simulations.
method RiGCS combines MLMC-HB with generative models to improve sampling efficiency.
result RiGCS achieves significantly higher effective sample size than existing methods.
We study the problem of detecting critical structures using a graph embedding model. Existing graph embedding models lack the ability to precisely detect critical structures that are specific to a task at the global scale. In this paper, we propose a novel graph embedding model, called the Ego-CNNs, that employs the eg…
This paper studies the critical dynamics of random surfaces, focusing on area and genus evolution.
problem Understanding the time evolution of random surfaces and their genus.
method Analyzes the dynamics of area and genus using Cox-Ingersoll-Ross process and critical phenomena.
result The genus of surfaces evolves into two phases: planar surfaces and foamy surfaces.
This paper reverses a construction by merging boundary critical points into an interior one.
problem Pushing interior critical points to the boundary and splitting them into two boundary points.
method Specific assumptions allow merging two boundary critical points into one interior critical point.
result Merging two boundary critical points into a single interior critical point.
Urban transformations within large and growing metropolitan areas often generate critical dynamics affecting social interactions, transport connectivity and income flow distribution. We develop a statistical-mechanical model of urban transformations, exemplified for Greater Sydney, and derive a thermodynamic descriptio…
We consider the mean curvature evolution of rotationally symmetric surfaces. Using numerical methods, we detect critical behavior at the threshold of singularity formation resembling the one of gravitational collapse. In particular, the mean curvature simulation of a one-parameter family of initial data reveals the exi…