This work proposes an online learning approach to tighten constraints in stochastic control problems.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Paper derives constraints for Bayesian Knowledge Tracing parameters.
Develops methods for estimating constrained function-valued parameters in infinite-dimensional models.
Incorporating domain knowledge into the modeling process is an effective way to improve learning accuracy. However, as it is provided by humans, domain knowledge can only be specified with some degree of uncertainty. We propose to explicitly model such uncertainty through probabilistic constraints over the parameter sp…
New method uses logical relations to derive bounds and inequality constraints from causal models.
New loss function handles uncertain constraints in CSLO problems.
We introduce a novel generative formulation of deep probabilistic models implementing "soft" constraints on their function dynamics. In particular, we develop a flexible methodological framework where the modeled functions and derivatives of a given order are subject to inequality or equality constraints. We then chara…
Paper studies PSGD for constrained optimization problems and its statistical properties.
A Bayesian approach termed BAyesian Least Squares Optimization with Nonnegative L1-norm constraint (BALSON) is proposed. The error distribution of data fitting is described by Gaussian likelihood. The parameter distribution is assumed to be a Dirichlet distribution. With the Bayes rule, searching for the optimal parame…
Psychiatric neuroscience is increasingly aware of the need to define psychopathology in terms of abnormal neural computation. The central tool in this endeavour is the fitting of computational models to behavioural data. The most prominent example of this procedure is fitting reinforcement learning (RL) models to decis…
Improved Bayesian learning rule handles positive-definite constraints efficiently.
FISAR uses neural networks to optimize safe reinforcement learning with forward-invariant constraints.
This paper considers the problem of minimizing an expectation function over a closed convex set, coupled with a {\color{black} functional or expectation} constraint on either decision variables or problem parameters. We first present a new stochastic approximation (SA) type algorithm, namely the cooperative SA (CSA), t…
The constraints arising from DAG models with latent variables can be naturally represented by means of acyclic directed mixed graphs (ADMGs). Such graphs contain directed and bidirected arrows, and contain no directed cycles. DAGs with latent variables imply independence constraints in the distribution resulting from a…
Smoothness analysis of adversarial training reveals constraints cause more non-smoothness.
The paper classifies constraint mappings in optimization problems.
Privacy constraints affect learning Markov Random Fields differently.
Paper introduces new regression methods for consistent estimation of biophysical parameters.
New algorithm reduces robust optimization scale for better constraint satisfaction.
In this paper, we propose a simple, versatile model for learning the structure and parameters of multivariate distributions from a data set. Learning a Markov network from a given data set is not a simple problem, because Markov networks rigorously represent Markov properties, and this rigor imposes complex constraints…
MINTS uses a minimalist Bayesian framework to tackle multi-armed bandits with structural constraints.
This paper proposes an Adaptive Stochastic Model Predictive Control (MPC) strategy for stable linear time-invariant systems in the presence of bounded disturbances. We consider multi-input, multi-output systems that can be expressed by a Finite Impulse Response (FIR) model. The parameters of the FIR model corresponding…
Paper tackles nonparametric classification with privacy constraints, achieving optimal accuracy.
Spatially constrained Gaussian mixture models reduce covariance complexity.
So-called sparse estimators arise in the context of model fitting, when one a priori assumes that only a few (unknown) model parameters deviate from zero. Sparsity constraints can be useful when the estimation problem is under-determined, i.e. when number of model parameters is much higher than the number of data point…
The Schwartz-Smith model parameters are estimated using Kalman Filter with additional constraints.
This paper studies the properties of the optimal portfolio-consumption strategies in a {finite horizon} robust utility maximization framework with different borrowing and lending rates. In particular, we allow for constraints on both investment and consumption strategies, and model uncertainty on both drift and volatil…
A new Bayesian framework simplifies stochastic optimization by focusing on key parameters.
The conformal method is a technique for finding Cauchy data in general relativity solving the Einstein constraint equations, and its parameters include a conformal class, a conformal momentum (as measured by a densitized lapse), and a mean curvature. Although the conformal method is successful in generating constant me…
We study a budgeted hyper-parameter tuning problem, where we optimize the tuning result under a hard resource constraint. We propose to solve it as a sequential decision making problem, such that we can use the partial training progress of configurations to dynamically allocate the remaining budget. Our algorithm combi…
The majority of stylized facts of financial time series and several Value-at-Risk measures are modeled via univariate or multivariate GARCH processes. It is not rare that advanced GARCH models fail to converge for computational reasons, and a usual parsimonious approach is the GJR-GARCH model. There is a disagreement i…
Hidden variables are ubiquitous in practical data analysis, and therefore modeling marginal densities and doing inference with the resulting models is an important problem in statistics, machine learning, and causal inference. Recently, a new type of graphical model, called the nested Markov model, was developed which …
Bayesian models use hyperparameters to indirectly assign priors, and this work shows how these priors can be derived from maximum entropy principles.
Semi-supervised clustering methods incorporate a limited amount of supervision into the clustering process. Typically, this supervision is provided by the user in the form of pairwise constraints. Existing methods use such constraints in one of the following ways: they adapt their clustering procedure, their similarity…
Researchers develop methods for inference in hierarchical models using neural simulations.
Efficient algorithms for sparse parameter recovery in mixture models.
Paper improves deep learning for solving evolutionary equations with trainable hard constraints.
Despite the great achievements of deep neural networks (DNNs), the vulnerability of state-of-the-art DNNs raises security concerns of DNNs in many application domains requiring high reliability.We propose the fault sneaking attack on DNNs, where the adversary aims to misclassify certain input images into any target lab…
Investigates ways to train larger models with fewer resources, finding that test loss depends only on the actual number of trainable parameters.
Simplifies neural network constraints with computationally efficient method.
We derive a closed form solution for an optimal control problem related to an interbank lending schemes subject to terminal probability constraints on the failure of banks which are interconnected through a financial network. The derived solution applies to a real banks network by obtaining a general solution when the …
DeepONets combine neural networks with physics constraints for PDEs and parameter estimation.
New framework improves generative models with prediction and consistency constraints.
Lower bounds on online logistic regression regret rates derived.
A neural network with a single hidden layer can't represent certain multivariable functions.
A framework estimates categorical distributions under constraints, ensuring generality and uniqueness.
Recently there has been sustained interest in modifying prediction algorithms to satisfy fairness constraints. These constraints are typically complex nonlinear functionals of the observed data distribution. Focusing on the path-specific causal constraints proposed by Nabi and Shpitser (2018), we introduce new theoreti…
Physics-informed neural networks improve by measuring effective dimensionality of constraints.