Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

199398597796 · Jun 202019922001200920172026
48 results for freezing sets

The early layers of a deep neural net have the fewest parameters, but take up the most computation. In this extended abstract, we propose to only train the hidden layers for a set portion of the training run, freezing them out one-by-one and excluding them from the backward pass. Through experiments on CIFAR, we empiri…

2017-06-15abs ↗pdf ↗

Improved off-policy selection and learning in contextual bandits with better guarantees.

problem Selecting or training a reward-maximizing policy using data from a fixed behavior policy.
method A betting-based confidence bound applied to an inverse propensity weight sequence for off-policy selection, and a freezing condition for off-policy learning.
result The proposed methods achieve significantly improved guarantees over prior work, especially in small-data regimes.

We continue the work of [10], studying properties of digital images determined by fixed point invariants. We introduce pointed versions of invariants that were introduced in [10]. We introduce freezing sets and cold sets to show how the existence of a fixed point set for a continuous self-map restricts the map on the c…

2019-04-01abs ↗pdf ↗

Analyzes how financial network dependencies can lead to multiple equilibrium outcomes and optimal bailout strategies.

problem Multiple equilibrium outcomes in financial networks due to dependency cycles.
method Characterized necessary and sufficient conditions for bank solvency, and provided upper bounds on optimal bailout payments.
result Minimum bailout payments needed to ensure systemic solvency and prevent cascading defaults.

We study the effect of liquidity freezes on an economic agent optimizing her utility of consumption in a perturbed Black-Scholes-Merton model. The single risky asset follows a geometric Brownian motion but is subject to liquidity shocks, during which no trading is possible and stock dynamics are modified. The liquidity…

2010-04-09abs ↗pdf ↗

Over the last few years, Deep Neural Networks (DNNs) have become ubiquitous owing to their high accuracy on real-world tasks. However, this increase in accuracy comes at the cost of computationally expensive models leading to higher prediction latencies. Prior efforts to reduce this latency such as quantization, model …

2020-02-07abs ↗pdf ↗

In this paper we develop a dynamic form of Bayesian optimization for machine learning models with the goal of rapidly finding good hyperparameter settings. Our method uses the partial information gained during the training of a machine learning model in order to decide whether to pause training and start a new model, o…

2014-06-16abs ↗pdf ↗

Some tasks, such as surface normals or single-view depth estimation, require per-pixel ground truth that is difficult to obtain on real images but easy to obtain on synthetic. However, models learned on synthetic images often do not generalize well to real images due to the domain shift. Our key idea to improve domain …

2019-08-16abs ↗pdf ↗

Paper explores BERT's efficiency on SQuAD2.0, freezing layers and using adapters.

problem Improving BERT's efficiency for SQuAD2.0 while maintaining performance.
method Freezing transformer layers, using adapters, and context-aware convolutional filters.
result Context-aware convolutional filters do not improve practical efficiency.

We examine in this article the pricing of target volatility options in the lognormal fractional SABR model. A decomposition formula by Ito's calculus yields a theoretical replicating strategy for the target volatility option, assuming the accessibilities of all variance swaps and swaptions. The same formula also sugges…

2018-01-24abs ↗pdf ↗

Study on reliability of latent reuse in diffusion models under distribution shift.

problem When can latent spaces from a source dataset be reused for a target dataset with different distributions?
method Considered a source-target setting with approximately low-dimensional datasets near different subspaces. Analyzed the target-domain score error due to principal-angle misalignment and target ambient noise.
result Latent reuse is reliable only if the source and target subspaces are close and the target ambient noise is not too amplified.

This paper formalises the problem of online algorithm selection in the context of Reinforcement Learning. The setup is as follows: given an episodic task and a finite number of off-policy RL algorithms, a meta-algorithm has to decide which RL algorithm is in control during the next episode so as to maximize the expecte…

2017-01-30abs ↗pdf ↗

Trust lies at the crux of most economic transactions, with credit markets being a notable example. Drawing on insights from the literature on coordination games and network growth, we develop a simple model to clarify how trust breaks down in financial systems. We show how the arrival of bad news about a financial agen…

2009-11-16abs ↗pdf ↗

We develop a multi-factor stochastic volatility Libor model with displacement, where each individual forward Libor is driven by its own square-root stochastic volatility process. The main advantage of this approach is that, maturity-wise, each square-root process can be calibrated to the corresponding cap(let)vola-stri…

2012-04-25abs ↗pdf ↗

Algorithm optimizes ε-SVR with MAPE loss and sample-dependent constraints.

problem Optimizing ε-SVR with MAPE loss and sample-dependent constraints.
method Sequential Minimal Optimization (SMO) for ε-SVR with MAPE loss and sample-dependent box constraints.
result Algorithm achieves lowest median runtime on every tested configuration.

Efficient RL algorithm for MDPs with linear QπQ^π realizability, achieving optimal regret bound.

problem Efficient reinforcement learning under linear QπQ^π realizability assumption for MDPs with stochastic dynamics.
method Frozen Policy Iteration algorithm that uses high-confidence data and freezes policy for well-explored states.
result Achieves optimal regret bound of O~(d2H6T)\widetilde{O}(\sqrt{d^2H^6T}) for linear (contextual) bandits.

Generative diffusion models gradually memorize training data, losing independent dimensions.

problem Understanding how generative diffusion models memorize training data, especially on low-dimensional manifolds.
method Measuring latent dimensionality via the learned score field, proposing a geometric memorization theory.
result Generative diffusion models experience a smooth collapse of their capacity to vary across independent directions as data become scarce, leading to near point-wise replication of salient features.

The paper explores how neural networks learn logical functions and their generalization error.

problem Learning logical functions with neural networks and understanding generalization error.
method Gradient descent on neural networks, analyzing noise-stability and Boolean influence.
result Gradient descent on certain neural architectures tends to favor low-degree representations, impacting generalization error.

New insights into CE dynamics reveal how Hadamard initialization simplifies softmax.

problem Understanding the dynamics of cross-entropy training loss in deep learning.
method Analyzing a two-layer linear neural network with standard-basis vectors as inputs.
result Gradient flow on cross-entropy converges to neural collapse geometry, proving global convergence.

There are many award-winning pre-trained Convolutional Neural Network (CNN), which have a common phenomenon of increasing depth in convolutional layers. However, I inspect on VGG network, which is one of the famous model submitted to ILSVRC-2014, to show that slight modification in the basic architecture can enhance th…

2019-11-20abs ↗pdf ↗

Is there a general economic pathway recapitulated by individual cities over and over? Identifying such evolution structure, if any, would inform models for the assessment, maintenance, and forecasting of urban sustainability and economic success as a quantitative baseline. This premise seems to contradict the existing …

2018-10-19abs ↗pdf ↗