Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

275480107 · Jun 202019922001200920172026
48 results for partial freezing

Improved off-policy selection and learning in contextual bandits with better guarantees.

problem Selecting or training a reward-maximizing policy using data from a fixed behavior policy.
method A betting-based confidence bound applied to an inverse propensity weight sequence for off-policy selection, and a freezing condition for off-policy learning.
result The proposed methods achieve significantly improved guarantees over prior work, especially in small-data regimes.

In this paper we develop a dynamic form of Bayesian optimization for machine learning models with the goal of rapidly finding good hyperparameter settings. Our method uses the partial information gained during the training of a machine learning model in order to decide whether to pause training and start a new model, o…

2014-06-16abs ↗pdf ↗

The early layers of a deep neural net have the fewest parameters, but take up the most computation. In this extended abstract, we propose to only train the hidden layers for a set portion of the training run, freezing them out one-by-one and excluding them from the backward pass. Through experiments on CIFAR, we empiri…

2017-06-15abs ↗pdf ↗

We study the effect of liquidity freezes on an economic agent optimizing her utility of consumption in a perturbed Black-Scholes-Merton model. The single risky asset follows a geometric Brownian motion but is subject to liquidity shocks, during which no trading is possible and stock dynamics are modified. The liquidity…

2010-04-09abs ↗pdf ↗

Over the last few years, Deep Neural Networks (DNNs) have become ubiquitous owing to their high accuracy on real-world tasks. However, this increase in accuracy comes at the cost of computationally expensive models leading to higher prediction latencies. Prior efforts to reduce this latency such as quantization, model …

2020-02-07abs ↗pdf ↗

We continue the work of [10], studying properties of digital images determined by fixed point invariants. We introduce pointed versions of invariants that were introduced in [10]. We introduce freezing sets and cold sets to show how the existence of a fixed point set for a continuous self-map restricts the map on the c…

2019-04-01abs ↗pdf ↗

Analyzes how financial network dependencies can lead to multiple equilibrium outcomes and optimal bailout strategies.

problem Multiple equilibrium outcomes in financial networks due to dependency cycles.
method Characterized necessary and sufficient conditions for bank solvency, and provided upper bounds on optimal bailout payments.
result Minimum bailout payments needed to ensure systemic solvency and prevent cascading defaults.

Some tasks, such as surface normals or single-view depth estimation, require per-pixel ground truth that is difficult to obtain on real images but easy to obtain on synthetic. However, models learned on synthetic images often do not generalize well to real images due to the domain shift. Our key idea to improve domain …

2019-08-16abs ↗pdf ↗

Paper explores BERT's efficiency on SQuAD2.0, freezing layers and using adapters.

problem Improving BERT's efficiency for SQuAD2.0 while maintaining performance.
method Freezing transformer layers, using adapters, and context-aware convolutional filters.
result Context-aware convolutional filters do not improve practical efficiency.

We examine in this article the pricing of target volatility options in the lognormal fractional SABR model. A decomposition formula by Ito's calculus yields a theoretical replicating strategy for the target volatility option, assuming the accessibilities of all variance swaps and swaptions. The same formula also sugges…

2018-01-24abs ↗pdf ↗

Trust lies at the crux of most economic transactions, with credit markets being a notable example. Drawing on insights from the literature on coordination games and network growth, we develop a simple model to clarify how trust breaks down in financial systems. We show how the arrival of bad news about a financial agen…

2009-11-16abs ↗pdf ↗

We develop a multi-factor stochastic volatility Libor model with displacement, where each individual forward Libor is driven by its own square-root stochastic volatility process. The main advantage of this approach is that, maturity-wise, each square-root process can be calibrated to the corresponding cap(let)vola-stri…

2012-04-25abs ↗pdf ↗

Generative diffusion models gradually memorize training data, losing independent dimensions.

problem Understanding how generative diffusion models memorize training data, especially on low-dimensional manifolds.
method Measuring latent dimensionality via the learned score field, proposing a geometric memorization theory.
result Generative diffusion models experience a smooth collapse of their capacity to vary across independent directions as data become scarce, leading to near point-wise replication of salient features.

There are many award-winning pre-trained Convolutional Neural Network (CNN), which have a common phenomenon of increasing depth in convolutional layers. However, I inspect on VGG network, which is one of the famous model submitted to ILSVRC-2014, to show that slight modification in the basic architecture can enhance th…

2019-11-20abs ↗pdf ↗

Study on reliability of latent reuse in diffusion models under distribution shift.

problem When can latent spaces from a source dataset be reused for a target dataset with different distributions?
method Considered a source-target setting with approximately low-dimensional datasets near different subspaces. Analyzed the target-domain score error due to principal-angle misalignment and target ambient noise.
result Latent reuse is reliable only if the source and target subspaces are close and the target ambient noise is not too amplified.

Training generative adversarial networks (GANs) on high quality (HQ) images involves important computing resources. This requirement represents a bottleneck for the development of applications of GANs. We propose a transfer learning technique for GANs that significantly reduces training time. Our approach consists of f…

2019-06-27abs ↗pdf ↗

Machine learning finds a compact fixed point action for SU(3) gauge theory.

problem Finding accurate and compact parametrizations of fixed point actions for SU(3) gauge theory.
method Used machine learning, specifically a gauge equivariant convolutional neural network.
result Obtained a superior parametrization of a fixed point action for SU(3) gauge theory.

SIREN protocol corrects optimistic winner's scores in LLM evaluation.

problem Optimistic winner's scores in LLM evaluation due to adaptive benchmarking.
method SIREN protocol that freezes post-search shortlist, separates selection and evaluation, and uses bootstrap for uncertainty quantification.
result SIREN provides valid confidence intervals for procedure-performance curves and deployment conclusions.

This paper formalises the problem of online algorithm selection in the context of Reinforcement Learning. The setup is as follows: given an episodic task and a finite number of off-policy RL algorithms, a meta-algorithm has to decide which RL algorithm is in control during the next episode so as to maximize the expecte…

2017-01-30abs ↗pdf ↗

We define systems of pre-extremals for the energy functional of regular rheonomic Lagrange manifolds and show how they induce well-defined Hamilton orthogonal nets. Such nets have applications in the modelling of e.g. wildfire spread under time- and space-dependent conditions. The time function inherited from such a Ha…

2017-08-24abs ↗pdf ↗