Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

63126189252 · Jun 202019922001200920172026
48 results for forced exploration

The paper explores MAB strategies for very short horizons, introducing new methods and showing improved performance.

problem Short horizon multi-armed bandit problems in games.
method Regression oracles, forced exploration, UCBT strategy.
result Combination of epsilon-greedy or epsilon-decreasing with regression oracles outperforms other strategies.

Develops Hamiltonian Score Matching and Generative Flows for machine learning.

problem Estimating score functions and designing generative models.
method Introduces Hamiltonian velocity predictors (HVPs) for score matching and generative flows.
result Hamiltonian Generative Flows (HGFs) rival leading generative modeling techniques.

Randomized exploration in linear bandits achieves optimal regret bounds.

problem Optimizing exploration in high-dimensional linear bandit problems.
method Analysis of Thompson sampling without forced optimism.
result Randomized exploration algorithms achieve an O(dnlog(n))O(d\sqrt{n} \log(n)) regret bound in smooth, strongly convex action spaces.

Neural networks' optimization dynamics are confined to a single basin despite connected basins in the loss landscape.

problem Neural networks' optimization dynamics are confined to a single basin despite connected basins in the loss landscape.
method Identifying entropic barriers arising from the interplay between curvature variations along low-loss paths and noise in optimization dynamics.
result Curvature-induced entropic forces bias noisy dynamics back toward the endpoints, explaining the confinement and connectivity of solutions.

Nearly all field theories suffer from singularities when particles are introduced. This is true in both classical and quantum physics. Classical field singularities result in the notorious self-force problem, where it is unknown how the dynamics of a particle change when the particle interacts with its own (self) field…

2015-03-03abs ↗pdf ↗

We study the effects of approximate inference on the performance of Thompson sampling in the kk-armed bandit problems. Thompson sampling is a successful algorithm for online decision-making but requires posterior inference, which often must be approximated in practice. We show that even small constant inference error …

2019-08-14abs ↗pdf ↗

We propose a unifying view of two different Bayesian inference algorithms, Stochastic Gradient Markov Chain Monte Carlo (SG-MCMC) and Stein Variational Gradient Descent (SVGD), leading to improved and efficient novel sampling schemes. We show that SVGD combined with a noise term can be framed as a multiple chain SG-MCM…

2018-11-30abs ↗pdf ↗

This study explores magnetic trajectories on the Heisenberg group, finding symmetries and solutions.

problem Understanding magnetic geodesics on the Heisenberg group with invariant Lorentz force.
method Analyzing the Heisenberg Lie group with a non-commutative product, deriving magnetic equations, identifying symmetries, and solving variational problems.
result Magnetic trajectories are solutions to a variational problem, providing explicit examples of Lagrangians.

Identifies conjugate points in spherical harmonics solutions of quasi-geostrophic equations.

problem Locating conjugate points in spherical harmonics solutions.
method Utilizing structure constants and quasi-geostrophic equations on the sphere, identifying conjugate points.
result Existence and location of conjugate points along spherical harmonics solutions.

New framework embeds physics in coarse-grained models without big data.

problem Lack of big data and computational demand in data-driven coarse-graining.
method Proposes a novel objective based on reverse Kullback-Leibler divergence that incorporates physics in the form of force fields.
result Generative coarse-grained model predicts atomistic configurations and reveals physicochemical CVs.

New algorithm CROP achieves asymptotic optimality with bounded regret.

problem Optimistic algorithms fail to achieve asymptotic instance-dependent regret optimality.
method CRush Optimism with Pessimism (CROP) algorithm that eliminates optimistic hypotheses.
result CROP achieves constant-factor asymptotic optimality and bounded regret.

Cosine similarity can force points to grow in magnitude, causing convergence issues.

problem Cosine similarity loss can lead to convergence issues in deep learning.
method Analyzing under-explored settings and proposing cut-initialization.
result Cosine similarity optimization forces points to grow in magnitude, leading to convergence issues.

New policy combines Thompson sampling with best challenger rule for best arm identification.

problem Best arm identification in bandit framework with fixed confidence.
method Combines Thompson sampling with best challenger rule.
result Asymptotically optimal for any two-armed bandit problems, near optimal for general K-armed bandit problems.

Study uses GPLFM to create Digital Twin for ferry quay health monitoring.

problem Deterioration of ferry quays due to harsh maritime environments and impacts.
method Gaussian Process Latent Force Model (GPLFM) integrating physics-based model and machine learning.
result GPLFM provides accurate acceleration response estimates, even under simplifying assumptions.

Lower bounds on eigenspectrum show rich action spaces force polynomial regret in linear bandits.

problem Understanding the minimum eigenvalue growth in linear bandits with rich action sets.
method Non-asymptotic lower bound on eigenspectrum of design matrix.
result Minimum eigenvalue of expected design matrix grows as Ω(n)Ω(\sqrt{n}) for sub-linear regret.

New method uses normalizing flows to improve force fields for coarse-grained molecular dynamics.

problem Lack of reference atomistic forces makes force matching infeasible for MLCG force fields.
method Introduces noise-based kernels adapted to low-data regimes using normalizing flows.
result Flow-based kernels reduce local distortions while preserving global accuracy.

Paper introduces Decentralized Non-stationary Competing Bandits ( exttt{DNCB}) for dynamic matching markets.

problem Understanding dynamic two-sided matching markets with competing agents.
method Proposes a decentralized asynchronous learning algorithm ( exttt{DNCB}) for non-stationary environments.
result Obtains sub-linear (logarithmic) regret of exttt{DNCB} in dynamic settings.

New algorithm efficiently trains machine learning models to atomic forces data.

problem Efficiently training machine learning models to large amounts of force data.
method Developed an efficient algorithm for training machine learning models to all available force data.
result Training to all available force data is only a few times more expensive than training to energies alone.

The paper integrates dissipative and curl forces using geometric methods.

problem Incorporating dissipative forces into curl forces for non-conservative systems.
method Geometric metriplectic approach, Herglotz principle, generalized Euler-Lagrange equation, Galley's method.
result Natural formulations for Lagrangian and Hamiltonian dynamics of non-conservative systems.

Optimism about the poorly understood states and actions is the main driving force of exploration for many provably-efficient reinforcement learning algorithms. We propose optimism in the face of sensible value functions (OFVF)- a novel data-driven Bayesian algorithm to constructing Plausibility sets for MDPs to explore…

2019-04-17abs ↗pdf ↗

Improved CG force-field learning from all-atom data.

problem Training accurate coarse-grained models from all-atom simulations is challenging.
method Optimized force mapping to improve statistical efficiency of force-field learning.
result Substantially improved CG force-fields can be learned from the same simulation data.

Paper introduces a PDE-free method for decomposing forces in any dimension.

problem Analyzing non-conservative forces in arbitrary dimensions.
method Geometric decomposition using homotopy operator and Frobenius theorem.
result Decomposes forces into gradient and antiexact components, characterizing curl forces.

Proposes linking energy and force uncertainty in deep learning potentials.

problem Uncertainty in predicted energies and forces in machine learning models.
method Introduces a spatially correlated noise process to link energy and force uncertainty.
result Demonstrates the approach on molecular datasets, linking energy and force uncertainties.

Aims to optimize complex multivariate systems with constraints.

problem Optimizing force-field systems in physics with large-scale simulations.
method Combines machine learning and experimental design to find feasible input combinations.
result Locates multiple good regions in the input space.

We consider a generalization of the notion of a natural mechanical system to the case of additional forces of gyroscopic type. Such forces appear, for example, as a result of global reduction of a natural system with symmetry. We study symmetries in the systems with gyroscopic forces to find out when these systems admi…

2014-02-04abs ↗pdf ↗

The paper analyzes errors in mechanical systems with external forces.

problem Error analysis of mechanical systems with external forces.
method Analysis of variational integrators with contact order rr for discrete mechanical systems.
result The contact order of the integrator is the same as the contact order of the original systems.

New algorithm reduces regret by allowing free exploration in multi-armed bandits.

problem Designing an adaptive policy to minimize regret with a free exploration budget.
method Introduced (α,β)(α,β)-probably saving policies and a two-phase algorithm UFE-KLUCB-H.
result UFE-KLUCB-H accumulates strictly less regret than non-free exploration policies.

Study curve flows with global forcing terms using a distance comparison principle.

problem Analyse the behavior of curves under curve flows with global forcing terms.
method Prove a distance comparison principle for curve shortening flow with arbitrary global forcing terms.
result Established a distance comparison principle for curve flows with global forcing terms.

Safe reinforcement learning with logical constraints for optimal policy synthesis.

problem Ensuring safety during reinforcement learning while maximizing goal satisfaction.
method Adaptive safe padding that synthesizes optimal control policies satisfying temporal logic formulas.
result The proposed method handles the trade-off between exploration and safety with theoretical guarantees.

While neural networks have acted as a strong unifying force in the design of modern AI systems, the neural network architectures themselves remain highly heterogeneous due to the variety of tasks to be solved. In this chapter, we explore how to adapt the Layer-wise Relevance Propagation (LRP) technique used for explain…

2019-09-25abs ↗pdf ↗

The paper finds that circles and logarithmic spirals are the only constant-speed ramps for a specific force field.

problem Determining planar curves for constant-speed motion under specific force conditions.
method Analyzing the motion of a particle under friction and a central force field.
result Every solution to the constant-speed motion problem approaches either a circle or a logarithmic spiral.

The Teacher Forcing algorithm trains recurrent networks by supplying observed sequence values as inputs during training and using the network's own one-step-ahead predictions to do multi-step sampling. We introduce the Professor Forcing algorithm, which uses adversarial domain adaptation to encourage the dynamics of th…

2016-10-27abs ↗pdf ↗

Proposes a new model to price options considering market forces beyond Black-Scholes.

problem Tackles the limitations of the Black-Scholes model in capturing unexpected market behaviors.
method Uses the analogy between quantum harmonic oscillator and financial market dynamics to propose a new market force-driven model.
result Shows how various market forces can be incorporated to modify option pricing, providing practical applications.

New insights into Hessian structure of neural networks reveal two forces.

problem Understanding the Hessian structure of neural networks.
method Analyzing the static and dynamic forces, comparing limit distributions using random matrix theory.
result The Hessian structure arises from a combination of static and dynamic forces, with CC being a primary driver.