Paper proposes Terminal Prediction to improve deep RL performance.
problem Sample inefficiency and convergence to locally optimal policies in deep reinforcement learning.
method Introduces a self-supervised auxiliary task, Terminal Prediction, to help representation learning.
result A3C-TP outperforms standard A3C in most domains and provides significant improvement in Pommerman.
Develops a learning model predictive controller for competitive racing.
problem Lack of exploration in state space and complexity in obstacle avoidance.
method Explores state space through multiple initializations and develops a new method for convex terminal set selection.
result Yields a richer terminal safe set and maintains convexity.
Predicts promising hyperparameters early to speed up machine learning.
problem Finding optimal hyperparameters is computationally expensive.
method Predict model performance without completing training, using early data.
result Improves performance of random search approach.
New test for SGD in binary classification reduces computation time.
problem Determining optimal stopping for SGD in binary classification.
method Proposes a new, simple, computationally inexpensive termination criterion for SGD.
result Termination criterion reduces expected misclassification probability.
A new BO termination criterion for HPO reduces optimization time without sacrificing test performance.
problem Determining an optimal budget for hyperparameter optimization.
method A new termination criterion based on the discrepancy between predictive and computable target performance.
result The proposed termination criterion achieves a better trade-off between test performance and optimization time.
In this paper, the `Approximate Message Passing' (AMP) algorithm, initially developed for compressed sensing of signals under i.i.d. Gaussian measurement matrices, has been extended to a multi-terminal setting (MAMP algorithm). It has been shown that similar to its single terminal counterpart, the behavior of MAMP algo…
Models for predicting aircraft motion are an important component of modern aeronautical systems. These models help aircraft plan collision avoidance maneuvers and help conduct offline performance and safety analyses. In this article, we develop a method for learning a probabilistic generative model of aircraft motion i…
Resource allocation improved using machine learning from terminal positions.
problem Optimizing resource allocation in next-gen wireless systems with fast-changing channel conditions.
method Supervised machine learning using position information of mobile terminals.
result Coordinates-based resource allocation performs similarly to traditional CSI-based methods.
Optimizes cash management in ATM networks to reduce costs and increase revenue.
problem Minimizing cash costs while ensuring adequate funds in a network of ATMs.
method Developed a discrete optimal control model using forecasting techniques and control theory.
result The proposed model outperforms classical inventory management models, earning 30% more revenue.
Proposes a new model to optimize investment plans with varying terminal times.
problem Improving the classical mean-variance model for continuous time investments.
method Uses stochastic optimal control and varying terminal time to determine optimal strategies.
result Optimal strategies and terminal times can be determined to minimize portfolio variance.
In this work we investigate approaches to reconstruct generator models from measurements available at the generator terminal bus using machine learning (ML) techniques. The goal is to develop an emulator which is trained online and is capable of fast predictive computations. The training is illustrated on synthetic dat…
Optimizes test set size for accurate diagnosis using machine learning.
problem Determining the minimum test set size for accurate diagnosis.
method Proposes machine learning methods (LASSO and SVM) to predict optimal test set size.
result SVM achieves 90.4% accuracy with a reduced test set by 35.24%.
In this work, we consider the problem of autonomously discovering behavioral abstractions, or options, for reinforcement learning agents. We propose an algorithm that focuses on the termination condition, as opposed to -- as is common -- the policy. The termination condition is usually trained to optimize a control obj…
Develops a new framework for perpetual futures on binary prediction markets.
problem Lack of effective risk management in perpetual futures on binary prediction markets.
method PIRAP framework with six components: index estimator, margin sizing, leverage, funding rule, halt protocol, and eligibility framework.
result Mixed results from empirical evaluation, with some pre-registered floors passing and others failing.
Study bounds for prices of European and American options with optional termination.
problem Bounding prices of options with potential termination.
method Duality results linking upper prices of vulnerable options to American options with constrained exercise times.
result Linking upper prices of vulnerable options to American options and game options.
The paper finds optimal threshold strategies for insurance companies with a positive terminal value at creeping ruin.
problem Optimizing dividend payments in an insurance company's surplus process with a positive terminal value at creeping ruin.
method Using fluctuation theory, the paper derives explicit formulas for the objective function and shows the optimality of threshold strategies.
result Threshold strategies are optimal for the dividend optimization problem under certain conditions.
New method preserves distances in time series data.
problem Preserving distances in time series data under interpolation.
method Developed lines-preserving terminal embeddings.
result First dimension-free coresets for Fréchet distance clustering.
Proves finite step termination of Kähler-Einstein metric singularity formation.
problem Singularity formation of Kähler-Einstein metrics.
method Finite step termination of bubble trees for singularity formation.
result Finite step termination of Kähler-Einstein metric singularity formation proved in non-collapsing situation.
The study proves a key inequality for specific types of three-dimensional spaces.
problem Establishing a mathematical inequality for a specific class of three-dimensional spaces.
method Developed the orbifold version of the Bogomolov-Gieseker inequality for stable Q-sheaves on log terminal Kähler threefolds.
result Proved the Bogomolov-Gieseker inequality for log terminal Kähler threefolds.
Employee stock options (ESOs) are American-style call options that can be terminated early due to employment shock. This paper studies an ESO valuation framework that accounts for job termination risk and jumps in the company stock price. Under general Lévy stock price dynamics, we show that a higher job termination ri…
We establish existence, uniqueness and regularity of solution results for a class of backward stochastic partial differential equations with singular terminal condition. The equation describes the value function of non-Markovian stochastic optimal control problem in which the terminal state of the controlled process is…
New method for computing terminal embeddings in sublinear time.
problem Efficiently computing terminal embeddings with sublinear time complexity.
method Developed a data structure to compute terminal embeddings in sublinear time.
result Achieved sublinear time computation of terminal embeddings.
We prove that the sum of the α-invariants of two different Kollár components of a Kawamata log terminal singularity is less than 1.
Locally adaptive clustering for tree delineation.
problem Tree delineation from distance data.
method Locally adaptive hierarchical cluster termination.
result Multi-scale alternative to conventional termination criteria.
Is an option to early terminate a swap at its market value worth zero? At first sight it is, but in presence of counterparty risk it depends on the criteria used to determine such market value. In case of a single uncollateralised swap transaction under ISDA between two defaultable counterparties, the additional unilat…
A new framework models multi-state events and biomarkers.
problem Limited representation of complex multi-state trajectories.
method General multi-state joint modeling framework.
result Accurate parameter recovery and personalized predictions.
In reinforcement learning, a decision needs to be made at some point as to whether it is worthwhile to carry on with the learning process or to terminate it. In many such situations, stochastic elements are often present which govern the occurrence of rewards, with the sequential occurrences of positive rewards randoml…
Study optimal liquidation with multiple regimes using BSDEs with singular terminal values.
problem Optimal liquidation with regime switching in dark pools.
method Introduced a system of BSDEs with jumps and singular terminal values.
result Existence and uniqueness results for the BSDE system are obtained.
New algorithm predicts lung cancer progression and mortality.
problem Predicting semi-competing risk outcomes in lung cancer.
method Neural Expectation-Maximization algorithm for multi-state outcomes.
result Estimates non-parametric baseline hazards and risk functions.
This paper establishes the existence of a unique nonnegative continuous viscosity solution to the HJB equation associated with a Markovian linear-quadratic control problems with singular terminal state constraint and possibly unbounded cost coefficients. The existence result is based on a novel comparison principle for…
In many environments only a tiny subset of all states yield high reward. In these cases, few of the interactions with the environment provide a relevant learning signal. Hence, we may want to preferentially train on those high-reward states and the probable trajectories leading to them. To this end, we advocate for the…
New reward function improves GAIL performance in task-based environments.
problem Reward bias in adversarial imitation learning.
method Proposed a new reward function to overcome existing biases.
result New reward function outperforms existing methods in task-based environments.
We provide representations of solutions to terminal value problems of inhomogeneous Black-Scholes equations and studied such general properties as min-max estimates, gradient estimates, monotonicity and convexity of the solutions with respect to the stock price variable, which are important for financial security prici…
Circular nets with spherical parameter lines have geometric properties related to Darboux cyclides and terminating Laplace sequences.
problem Discretizing surfaces with spherical curvature lines.
method Lie-geometric discretisation in terms of principal contact element nets.
result Circular nets with two families of spherical parameter lines are related to Darboux cyclides.
New framework values ESOs with multiple exercises and job termination risk.
problem Valuing ESOs with complex exercise patterns and job termination risk.
method Fourier transform, finite differences, and maturity randomization methods.
result Analytic formulae for ESO costs under various conditions.
TVM improves generative modeling by matching terminal velocities.
problem Creating high-fidelity one- and few-step generative models.
method TVM generalizes flow matching, modeling transitions between diffusion timesteps and regularizing terminal behavior.
result TVM achieves state-of-the-art FID scores with minimal architectural changes and fused attention kernel.
We apply the language of the groupoid approach to Lie pseudo-groups, and the classical Cartan-Kuranishi theorem, to prove that Cartan's equivalence method terminates at involution (or at complete reduction) for constant type problems.
We study optimal trading in an Almgren-Chriss model with running and terminal inventory costs and general predictive signals about price changes. As a special case, this allows to treat optimal liquidation in "target zone models": asset prices with a reflecting boundary enforced by regulatory interventions. In this cas…
The paper analyzes and proposes a new stopping criterion for recursive Bayesian classification.
problem Limitations of conventional stopping criteria in recursive Bayesian classification.
method Geometric interpretation of state posterior progression and analysis of conventional criteria.
result Proposes a new stopping criterion to overcome limitations of conventional methods.
Energy-efficient detection of natural errors in deep networks.
problem Deep networks lack error detection capability without additional energy costs.
method Append RACs at hidden layers to detect natural errors with early classification termination.
result Early classification termination reduces energy consumption.
A new algorithm LONR learns without terminal states or perfect recall.
problem Learning in settings without terminal states or perfect recall.
method Local No-Regret Learning (LONR) using Q-learning-like updates.
result LONR achieves last iterate convergence in challenging settings.
Researchers find Kähler-Einstein metrics near isolated log terminal singularities.
problem Existence of Kähler-Einstein metrics with positive curvature near isolated log terminal singularities.
method Solving complex Monge-Ampère equations to analyze the existence of metrics.
result Existence of smooth solutions in subcritical regimes, with critical exponent expressed in terms of normalized volume.
The paper predicts edge weights in weighted directed networks using metric geometry.
problem Predicting edge weights in weighted directed networks.
method Introducing new types of weighted directed networks (AWDNs), constructing metrics, and proposing modified kNN and SVM methods.
result The proposed methods outperform traditional approaches in predicting edge weights.
This paper extends risk parity to continuous-time, solving risk budgeting problems.
problem Achieving robust risk across different assets in continuous-time.
method Characterizing risk contributions and solving risk budgeting problems using continuous-time terminal variance.
result Risk contributions and risk budgets can be represented as predictable processes in continuous-time.
Optimal asset allocation strategy outperforms stochastic benchmark.
problem Achieving higher terminal wealth than a stochastic benchmark.
method Data-driven Neural Network optimization framework for dynamic asset allocation.
result Optimal adaptive strategy outperforms benchmark with higher median and right-skewed terminal wealth.
ETCNN uses neural networks to price American options accurately.
problem Accurately pricing American options with inequality constraints.
method ETCNN framework solving BSM equations with exact terminal condition.
result ETCNN achieves high accuracy and robustness across various scenarios.
We study the existence of a minimal supersolution for backward stochastic differential equations when the terminal data can take the value +∞ with positive probability. We deal with equations on a general filtered probability space and with generators satisfying a general monotonicity assumption. With this minim…
The paper examines special Q-nets that terminate after a finite number of Laplace steps.
problem Understanding the termination of Laplace sequences in Q-nets.
method Analyzing discrete Koenigs nets and their Laplace sequences.
result For certain Koenigs nets, Laplace sequences terminate after a finite number of steps.