Study optimality conditions for interval-valued optimization problems on Riemannian manifolds.
problem Optimizing interval-valued functions on Riemannian manifolds under a total order relation.
method Generalized Hukuhara directional differentiability to derive KKT-type optimality conditions.
result Derives optimality conditions for interval-valued optimization problems on Riemannian manifolds.
KOVA optimizes value functions using Kalman filtering, improving parameter uncertainty.
problem Improving parameter uncertainty in value function approximation.
method KOVA uses a trust region approach with a Bayesian perspective and Kalman filtering.
result KOVA provides more reliable parameter estimates and value function approximations.
Optimal clustering handles missing values without imputation.
problem Missing values complicate clustering algorithms in biomedical studies.
method Integrates missing value mechanism into optimal clustering framework.
result Superior performance compared to other clustering approaches.
Proposes SOR Q-learning for faster optimal value function computation in RL.
problem Finding optimal value function in Markov Decision Processes (MDPs).
method Successive Over-Relaxation (SOR) applied to Q-learning algorithm.
result SOR Q-learning converges faster to optimal value function compared to standard Q-learning.
DVA framework attributes value of predictive models to features, configurations, and interactions.
problem Lack of explanation for how predictive models influence operational decisions.
method Shapley-based cooperative game theory applied to predict-then-optimize systems.
result DVA can guide targeted interventions to align model beliefs with operational performance.
This work optimizes bid strategies for online auctions using measure-valued optimization.
problem Optimizing bid strategies in first-price auctions to maximize expected surplus.
method Formulates the problem as convex optimization over the joint distribution of shading parameters, adapts the distribution after each auction using a Wasserstein-proximal update.
result The proposed algorithm encourages bids on values with high expected surplus.
The paper finds optimal threshold strategies for insurance companies with a positive terminal value at creeping ruin.
problem Optimizing dividend payments in an insurance company's surplus process with a positive terminal value at creeping ruin.
method Using fluctuation theory, the paper derives explicit formulas for the objective function and shows the optimality of threshold strategies.
result Threshold strategies are optimal for the dividend optimization problem under certain conditions.
DMPC combines MPC and value function estimation for efficient control tasks.
problem Efficiently solve control tasks with sparse and binary reward signals.
method Actor-critic algorithm combining MPC and value function estimation.
result DMPC actor minimizes an upper bound of cross-entropy to optimal policy.
Proposes a faster second-order method for MDPs.
problem Slow convergence of first-order value iteration methods in MDPs.
method Applies Newton-Raphson method to successive relaxation value iteration scheme.
result Second-order convergence and faster convergence to optimal solution.
Paper introduces a new value function for state transitions and optimal policy learning.
problem Learning optimal policies from state transitions and actions.
method Develops a forward dynamics model to maximize a novel value function Q(s,s′). result Demonstrates benefits in value function transfer, redundant action spaces, and off-policy learning.
Study KKT conditions for multi-objective optimization on Hadamard manifolds.
problem Optimizing multi-objective interval-valued functions on Hadamard manifolds.
method Developed KKT conditions for Pareto optimal solutions under different ordering and convexity notions.
result Results are more general than on Euclidean spaces.
Optimal coupling among random vectors with known statistics and correlation structure found using minimum spanning tree over measure-valued vertices.
problem Finding the optimal coupling among random vectors with known statistics and correlation structure.
method Formulating the problem as a minimum spanning tree over measure-valued vertices and solving it in two steps.
result Optimal coupling found using the minimum spanning tree approach.
FFBO optimizes functions as inputs and outputs, improving on existing BO methods.
problem Optimizing functions as both inputs and outputs in complex systems.
method Function-on-function Gaussian process (FFGP) model with a separable operator-valued kernel, scalar upper confidence bound (UCB) acquisition function, and scalable functional gradient ascent algorithm (FGA).
result FFBO outperforms existing methods in synthetic and real-world data.
Study non-rectangular robust MDPs for average-reward, finding optimal policies and transient values.
problem Non-rectangular robust Markov decision processes under average-reward criterion.
method Proves history-dependent policies are robust-optimal, introduces transient-value framework, constructs epoch-based policy.
result Existence and properties of robust optimal policies, transient value bounds.
Proposes a method to create fair ITRs that balance value and fairness.
problem Fairness issues in ITRs that can lead to unfair advantages or disadvantages.
method Optimal transport theory to transform optimal ITRs into fair ITRs.
result Established a theoretical upper bound on value loss for improved trade-off ITRs.
SVD improves neural network optimization.
problem Optimizing neural networks.
method Using SVD as an initial guess for neural network parameters.
result Better optimization results.
Optimal transport for vector Gaussian mixtures improves efficiency and structure preservation.
problem Optimal mass transport for vector-valued Gaussian mixtures.
method Vectorizing Gaussian mixture models and studying optimal mass transport problems.
result Computational efficiency and structure preservation in optimal mass transport.
This work explores representation complexity in RL paradigms, revealing model-based RL as the easiest task.
problem Investigating the representation complexity gap among model-based, policy-based, and value-based RL.
method Demonstrated through analysis of Markov decision processes (MDPs) and introduced new classes of MDPs.
result Representation complexity hierarchy: model-based RL > policy-based RL > value-based RL.
Optimal rates for vector-valued regression on various norms.
problem Optimal rates for vector-valued ridge regression on continuous norms.
method Combining standard capacity assumptions with tensor product constructions of vector-valued interpolation spaces.
result Optimal rates for vector-valued ridge regression, independent of output space dimension.
Fuzzy prediction sets generalize binary predictions to include elements at varying confidence levels.
problem Binary prediction sets are limited; fuzzy prediction sets offer richer guarantees.
method Generalize prediction sets to fuzzy sets, showing they are e-values with merging properties.
result Optimal e-values lead to optimal fuzzy prediction sets, including optimal conformal prediction.
Solves VaR-constrained portfolio optimization in markets with stochastic volatility.
problem Optimizing portfolio in markets with stochastic volatility under VaR constraints.
method Dynamic programming approach to Heston's stochastic volatility model.
result Optimal investment strategy linked to unconstrained problem via a vega-neutral derivative.
Optimizes bond portfolios to avoid worst-case losses.
problem Finding the worst-case value of a bond portfolio over a range of yield curves and spreads.
method Solves a convex-concave saddle point optimization problem to find the worst-case value and construct a robust portfolio.
result Constructs a bond portfolio that includes the worst-case value, ensuring robustness against market uncertainties.
A new framework for robust risk measurement and portfolio optimization.
problem Uncertainty in mean-covariance space and portfolio optimization challenges.
method Modeling uncertainty with Gelbrich distance and prior structural information, related to optimal transport theory.
result Mean-covariance robust portfolio optimization simplifies to Markowitz model with a regularization term.
This paper interpolates reward functions to predict optimal value functions in MORL.
problem Finding optimal value functions in MORL requires recomputing for each set of weights.
method Interpolating reward function weights to smooth value function transformations.
result Smooth interpolation of optimal value functions over reward function weights.
The paper examines optimal insurance design using Lambda-Value-at-Risk.
problem Optimal insurance design based on Lambda-Value-at-Risk.
method Analyzes optimal insurance solutions using Lambda-Value-at-Risk and closed-form expressions.
result Truncated stop-loss indemnity is optimal under certain conditions.
Study efficient policy value estimation with sublinear samples.
problem Estimating optimal policy value in stochastic disjoint linear bandits.
method Sublinear sample estimation of optimal policy value.
result Achieves near optimal estimation error with sublinear samples.
New framework optimizes for 'value' rather than engagement.
problem Gap between engagement signals and desired notion of 'value'.
method Measurement theory framework, latent variable model, qualitative evaluation.
result Operationalizes and optimizes for a desired notion of 'value'.
Researchers developed a new Riemannian manifold for SPD matrix-valued optimal transport problems.
problem Optimal transport between SPD matrix-valued measures.
method Formulated as a generalized optimal transport problem with block SPD matrices, endowed with a novel Riemannian manifold structure.
result The novel Riemannian manifold allows solving SPD matrix-valued optimal transport problems using Riemannian optimization.
New approach shows continuity and compactness of martingale measures.
problem Stability of martingale optimal transport problem.
method Set-valued map theory and lower-upper hemicontinuity.
result Lower and upper hemicontinuity of the set of martingale measures.
Proposes a low-cost method to set hyperparameters using optimized default values.
problem Challenges of setting hyperparameters by trial and error, leading to subjective and inefficient results.
method Generates optimized default values using a small set of values that outperform existing defaults and tuned values.
result New default values deliver better predictive performance and are competitive with tuned values, making them easier to use.
Optimizes target value in stochastic black box functions.
problem Finding input to minimize expected squared error to target value.
method Derives acquisition functions for expected improvement, probability of improvement, and lower confidence bound, assuming Gaussian aleatoric effects.
result Acquisition functions can outperform classical Bayesian optimization under certain conditions.
A new framework for generative modeling using value-driven transport.
problem Developing efficient methods for generative modeling.
method A discrete-time stochastic control formulation of measure transport, formulated as a linear program with dual variables corresponding to the optimal value function.
result Well-trained VDT policies lead to straight transport paths that can be simulated quickly and robustly.
Long term optimal investment problems are studied in a factor model with matrix valued state variables. Explicit parameter restrictions are obtained under which, for an isoelastic investor, the finite horizon value function and optimal strategy converge to their long-run counterparts as the investment horizon approache…
This paper studies the problem of optimally extracting nonrenewable natural resource in light of various financial and economic restrictions and constraints. Taking into account the fact that the market values of the main natural resources i.e. oil, natural gas, copper,...,etc, fluctuate randomly following global and s…
VaR-CPO optimizes VaR-constrained RL problems with conservative policy updates.
problem Optimizing VaR-constrained reinforcement learning problems.
method Combines Cantelli's inequality and trust-region framework for efficient and conservative optimization.
result Achieves zero constraint violations during training in feasible environments.
Proposes a method to handle missing inputs in Bayesian optimization.
problem Missing values in historical data and function evaluations.
method Impute missing values using probability distributions and develop a new acquisition function.
result Improves performance of Bayesian optimization by handling missing inputs effectively.
The optimal capital structure model with endogenous bankruptcy was first studied by Leland (1994) and Leland and Toft (1996), and was later extended to the spectrally negative Levy model by Hilberink and Rogers (2002) and Kyprianou and Surya (2007). This paper incorporates the scale effects by allowing the values of ba…
Study finds weak solutions for complex map flows with optimal lifespan.
problem Existence of weak solutions for two-phase matrix-valued harmonic map flows.
method Modified minimizing movement scheme, discretizing time and interpolating solutions.
result Existence of weak solutions with optimal lifespan for the limiting system.
Unified minimax value interval for off-policy evaluation and optimization.
problem Overcoming the exponential variance in off-policy evaluation and policy optimization.
method Unified minimax value interval using marginalized importance weights.
result Unified value interval with double robustness, valid when either value-function or importance-weight class is well specified.
Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR) are popular risk measures from academic, industrial and regulatory perspectives. The problem of minimizing CVaR is theoretically known to be of Neyman-Pearson type binary solution. We add a constraint on expected return to investigate the Mean-CVaR portfolio sele…
Optimizes trading strategy considering alpha decay and transaction costs.
problem Maximizing reward in a multi-period portfolio with transaction costs and alpha decay.
method Formulated as an infinite horizon Markov Decision Process, solved using a modified value iteration algorithm with convergence proof and asymptotic analysis.
result Characterized optimal trading policy that maximizes average expected reward.
This paper defines systematic value investing as an empirical optimization problem. Predictive modeling is introduced as a systematic value investing methodology with dynamic and optimization features. A predictive modeling process is demonstrated using financial metrics from Gray & Carlisle and Buffett & Clark. A 31-y…
Pion optimizes LLMs by preserving weight matrix singular values.
problem Training large language models (LLMs) with standard optimizers leads to unstable weight matrices.
method Pion uses orthogonal transformations to update weight matrices, preserving their singular values.
result Pion offers a stable alternative to standard optimizers for LLM pretraining and finetuning.
Study optimal liquidation with multiple regimes using BSDEs with singular terminal values.
problem Optimal liquidation with regime switching in dark pools.
method Introduced a system of BSDEs with jumps and singular terminal values.
result Existence and uniqueness results for the BSDE system are obtained.
Investor optimizes portfolio to manage risk with heavy-tailed stock returns.
problem Managing risk in portfolios with heavy-tailed stock returns.
method Markov Decision Process and dynamic programming for optimal strategies and value function.
result Optimal strategies and value function maximizing expected utility for both parametric and non-parametric distributions.
Develops a new method for statistical optimal allocation problems.
problem Statistical optimal allocation problems with constraints.
method Functional differentiability approach and Hadamard differentiability of value functions.
result Validates margin assumption for fast convergence rate of plug-in methods.
Study learns optimal bidding strategy in auctions with dynamic values and aggregated feedback.
problem Optimizing bidding in auctions with time-dependent values and limited feedback.
method Combines plug-in estimators with differential-equation characterization of optimal policy.
result Achieves near optimal regret bounds for learning optimal policy.
Adapting momentum from optimization to reinforcement learning.
problem Improving the convergence and stability of reinforcement learning algorithms.
method Introducing Momentum Value Iteration (MoVI) by incorporating an average of consecutive state-action value functions, inspired by the concept of momentum in optimization.
result MoVI improves the convergence and stability of reinforcement learning algorithms, as demonstrated by experiments on Atari games.