The paper explores solutions to the distributional Bellman equation in reinforcement learning.
problem Distributional reinforcement learning considers complete return distributions, not just expected returns.
method Study existence and uniqueness of solutions to general distributional Bellman equations, linking them to multivariate affine equations.
result Any solution to a distributional Bellman equation can be derived from a multivariate affine distributional equation.
The problem of determining the joint probability distributions for correlated random variables with pre-specified marginals is considered. When the joint distribution satisfying all the required conditions is not unique, the "most unbiased" choice corresponds to the distribution of maximum entropy. The calculation of t…
Transformer improves parameter estimation without needing closed-form solutions.
problem Parameter estimation in statistics, especially for complex distributions.
method Transformer-based approach for parameter estimation without closed-form solutions or derivations.
result Transformer-based approach achieves similar or better accuracy than maximum likelihood estimation.
ACOWA improves distributed sparse classification with extra communication round.
problem Efficiently optimizing sparse classification with limited communication.
method Introducing ACOWA, a new technique with an extra communication round.
result ACOWA achieves better approximation quality and higher accuracy.
New algorithm reduces communication in distributed eigenspace estimation.
problem Efficiently estimating eigenspaces in distributed settings without excessive communication.
method Communication-efficient distributed algorithm using Procrustean alignment.
result Achieves similar error rate to centralized estimator for PCA.
An analytic solution for asset allocation with Laplace distribution.
problem Asset allocation with multivariate Laplace distribution.
method Specialization of elliptically symmetric distribution theory to Laplace distribution, accounting for dimensionality and variance rescaling.
result A result consistent with conjecture but with differences due to omitted term and rescaling.
The paper studies how different entropic regularizations affect GAN solutions.
problem Improving numerical convergence and sparsity in GAN solutions.
method Entropic regularization of Wasserstein distance and Sinkhorn divergence.
result Entropy regularization promotes sparsity, while Sinkhorn divergence recovers unregularized solution.
Continuous functions on graphs in Carnot groups satisfy a Burgers' type equation.
problem Characterizing CH1-regularity of graphs in Carnot groups of step 2. method Proving equivalence between distributional solutions of Burgers' type equations and CH1-regularity of graphs. result Continuous functions on graphs in Carnot groups of step 2 satisfy a Burgers' type equation in the distributional sense.
Solutions to a differential equation link to contact structures.
problem Linking solutions of a specific differential equation to contact structures.
method Established a correspondence between solutions of Noth's equation and diffeomorphisms of contact structures.
result Established a correspondence between solutions of Noth's equation and diffeomorphisms of contact structures of type G2. Two derivations of PCA for distributional data.
problem PCA for datasets of distributions.
method Two derivations: variance maximization and reconstruction error minimization.
result Closed-form solution for distributional PCA.
Analyzes generalization error in distributed linear regression.
problem Understanding generalization performance in distributed learning.
method Analytical characterization of generalization error in linear regression with distributed learning.
result Generalization error increases dramatically when nodes estimate close to the number of observations.
In this paper is proposed a new heuristic approach belonging to the field of evolutionary Estimation of Distribution Algorithms (EDAs). EDAs builds a probability model and a set of solutions is sampled from the model which characterizes the distribution of such solutions. The main framework of the proposed method is an…
We consider the problem of computing the integrable sub-distributions of the non-integrable Vessiot distribution of multi-dimensional second order partial differential equations (PDEs). We use Vessiot theory and solvable structures to find the largest integrable distributions contained in the Vessiot distribution assoc…
Meta-learning base distributions for efficient PDE solutions.
problem Efficiently solving parametric parabolic PDEs across different scenarios.
method Meta-learning base distributions to compute PDE solutions.
result Improves generalization to new parameter regimes.
Proposes IPT for modeling complex joint distributions.
problem Lack of closed-form solutions for complex continuous or mixed distributions.
method Observer-centered framework with three independence axioms; derivation of closed-form solutions.
result Closed-form solutions for complex joint distributions under IPT.
A new algorithm reduces data dimensionality and decorrelation in a distributed setting.
problem Distributed PCA for decorrelated features in big data.
method Feedforward neural network-based one time-scale algorithm for estimating eigenvectors of distributed data covariance matrix.
result DSA converges linearly to the true solution.
We solve the mean parametrization of von Mises-Fisher distribution.
problem No closed-form normalization function for mean parameters exists.
method Derived a second-order ODE for mean normalizer and provided approximations.
result Rapid evaluation of densities and natural parameters in terms of mean parameters.
This work analyzes IRM and ERM from sample complexity perspective, revealing different behaviors under various distribution shifts.
problem Choosing between IRM and ERM for OOD generalization.
method Sample complexity analysis comparing IRM and ERM under different data generation mechanisms.
result IRM is preferred over ERM for certain distribution shifts, leading to better OOD generalization.
Local equivalence shown between specific distributions and flat Cartan distribution.
problem Establishing local equivalence between specific distributions and flat Cartan distribution.
method Change of coordinates mapping specific distributions to flat Cartan distribution.
result Local equivalence between maximally symmetric (2,3,5)-distributions and flat Cartan distribution. The implementation of optimal power flow (OPF) methods to perform voltage and power flow regulation in electric networks is generally believed to require extensive communication. We consider distribution systems with multiple controllable Distributed Energy Resources (DERs) and present a data-driven approach to learn c…
We define self-distributive structures in the categories of coalgebras and cocommutative coalgebras. We obtain examples from vector spaces whose bases are the elements of finite quandles, the direct sum of a Lie algebra with its ground field, and Hopf algebras. The self-distributive operations of these structures provi…
This work develops efficient methods for continuous-time distributional reinforcement learning.
problem Continuous-time reinforcement learning with return distributions.
method Parameterizing return distributions using quantile representation and showing topological properties.
result Efficient approximation algorithm for continuous-time distributional reinforcement learning.
We analyze a conservative market model for the competition among economic agents in a close society. A minimum dynamics ensures that the poorest agent has a chance to improve its economic welfare. After a transient, the system self-organizes into a critical state where the wealth distribution have a minimum threshold, …
Generic level sets in mean curvature flow are BV solutions.
problem Understanding the behavior of level sets in mean curvature flow.
method Using the framework of sets of finite perimeter and distributional solutions, the paper extends Evans and Spruck's work.
result Generic level sets are distributional solutions with optimal energy dissipation rate.
This work derives an approximate analytical single period solution of the portfolio choice problem for the power utility function. It is possible to do so if we consider that the asset returns follow a multivariate normal distribution. It is shown in the literature that the log-normal distribution seems to be a good pr…
Real-world problems typically require the simultaneous optimization of several, often conflicting objectives. Many of these multi-objective optimization problems are characterized by wide ranges of uncertainties in their decision variables or objective functions, which further increases the complexity of optimization. …
New approach to machine learning optimization using distribution space.
problem Optimization challenges in machine learning with non-convex constraints.
method Relaxation to convex optimization in distribution space, numerical algorithm based on mixture distributions.
result Approximate optimization in distribution space is consistent and effective.
We find various exact solutions for a new stochastic volatility (SV) model: the transition probability density, European-style option values, and (when it exists) the martingale defect. This may represent the first example of an SV model combining exact solutions, GBM-type volatility noise, and a stationary volatility …
This paper examines how optimization methods affect the reliability of detecting inputs outside a model's training distribution.
problem The unreliability of deep neural networks on out-of-distribution inputs.
method Analysis of optimization methods' impact on OOD detection approaches.
result Optimization methods significantly influence the robustness of OOD detection approaches.
We consider a class of discrete optimization problems that aim to maximize a submodular objective function subject to a distributed partition matroid constraint. More precisely, we consider a networked scenario in which multiple agents choose actions from local strategy sets with the goal of maximizing a submodular obj…
The paper solves the problem of optimal portfolio choice when the parameters of the asset returns distribution, like the mean vector and the covariance matrix are unknown and have to be estimated by using historical data of the asset returns. The new approach employs the Bayesian posterior predictive distribution which…
We propose LOCO, an algorithm for large-scale ridge regression which distributes the features across workers on a cluster. Important dependencies between variables are preserved using structured random projections which are cheap to compute and must only be communicated once. We show that LOCO obtains a solution which …
We consider robust optimization problems, where the goal is to optimize in the worst case over a class of objective functions. We develop a reduction from robust improper optimization to Bayesian optimization: given an oracle that returns α-approximate solutions for distributions over objectives, we compute a distrib…
Consider linear regression where the examples are generated by an unknown distribution on Rd×R. Without any assumptions on the noise, the linear least squares solution for any i.i.d. sample will typically be biased w.r.t. the least squares optimum over the entire distribution. However, we show that if an i.i.d…
Transformers learn to generalize out-of-distribution with diverse pretraining tasks.
problem Conditions for pretrained transformers to generalize out-of-distribution.
method Empirical study of task diversity and pretraining distribution.
result As task diversity increases, transformers transition from specialized to generalized solutions.
Entropy corrections improve GBM's predictive accuracy for non-log-normal distributions.
problem Log-normal distribution limitations in GBM predictions.
method Entropy corrections to geometric Brownian motion (GBM).
result Improved predictive accuracy for non-log-normal distributions.
Processing data collected by a network of agents often boils down to solving an optimization problem. The distributed nature of these problems calls for methods that are, themselves, distributed. While most collaborative learning problems require agents to reach a common (or consensus) model, there are situations in wh…
A new method for reconstructing flows from perturbed distributions.
problem Reconstructing flows from perturbed probability distributions.
method Integrable vector fields and Green's functions.
result A nonparametric flow can be computed to generate samples from a perturbed distribution.
The purpose of this work is to develop and study a distributed strategy for Pareto optimization of an aggregate cost consisting of regularized risks. Each risk is modeled as the expectation of some loss function with unknown probability distribution while the regularizers are assumed deterministic, but are not required…
MEP-Net uses MEP to generate solutions from limited data.
problem Generating solutions to scientific problems with incomplete information.
method Combines MEP with neural networks to learn complex distributions from moment constraints.
result Demonstrates MEP-Net's effectiveness in modeling biochemical reaction networks and generating complex distributions.
ICON learns differential equation operators from examples, revealing probabilistic inference.
problem Learning operators for differential equations from limited examples.
method Probabilistic operator learning using ICON architectures trained on diverse datasets.
result ICON implicitly performs Bayesian inference on solution operators.
Optimal control in latent factor models uses Tsallis entropy for exploration.
problem Optimal control in models with latent factors.
method Reward exploration with Tsallis entropy and derive q-Gaussian distribution over states. result Optimal policy derived in a model-agnostic setting.
Improved logistic regression for robustness to distribution shifts.
problem Distribution shifts in social and behavioral sciences.
method Distributionally robust logistic regression with graph-based solution.
result Significant improvement in calibration and AUC metrics.
We develop a new model for VIX derivatives with closed-form solutions.
problem VIX derivatives pricing and risk management.
method Data-driven Legendre polynomial model for VIX volatility, deriving analytical series solutions.
result Equal or superior accuracy compared to existing models, offering an efficient alternative.
This work proposes an unsupervised neural network framework for solving combinatorial optimization problems on graphs.
problem Challenges in neural networks solving combinatorial optimization problems without labeled instances.
method Inspired by Erdos' probabilistic method, a neural network parametrizes a probability distribution over sets, optimizing it to find low-cost integral solutions.
result The method provides valid solutions to the maximum clique problem and local graph clustering, achieving competitive results.
A theorem proves integrability of Fréchet tangent distributions.
problem Integrability of Fréchet tangent distributions on manifolds.
method Introduced Condition W, applied variational approach, used differential forms.
result Existence and uniqueness of maximal foliations.
The paper explores how over-parameterized linear regression models generalize without violating learning theory principles.
problem Understanding how over-parameterized linear regression models generalize without violating learning theory principles.
method The paper uses the predictive normalized maximum likelihood (pNML) learner to investigate the minimum norm solution of over-parameterized linear regression models.
result The model generalizes well when the test sample lies in a subspace spanned by eigenvectors associated with large eigenvalues of the training data.
This study aims to improve communication between fragmented blockchain systems in finance.
problem Inefficient and insecure communication in fragmented blockchain systems.
method Analysis of cross-chain interoperability protocols and their properties.
result Comparison and evaluation of cross-chain interoperability protocols.