Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

61122183244 · Jun 202019922001200920172026
48 results for response transformations

In this paper, we consider a generalized multivariate regression problem where the responses are monotonic functions of linear transformations of predictors. We propose a semi-parametric algorithm based on the ordering of the responses which is invariant to the functional form of the transformation function. We prove t…

2016-02-19abs ↗pdf ↗

Neural dialogue models, despite their successes, still suffer from lack of relevance, diversity, and in many cases coherence in their generated responses. These issues can attributed to reasons including (1) short-range model architectures that capture limited temporal dependencies, (2) limitations of the maximum likel…

2019-07-26abs ↗pdf ↗

Here, we present a novel approach to solve the problem of reconstructing perceived stimuli from brain responses by combining probabilistic inference with deep learning. Our approach first inverts the linear transformation from latent features to brain responses with maximum a posteriori estimation and then inverts the …

2017-05-19abs ↗pdf ↗

Extends RRR to capture nonlinear interactions in multi-response regression.

problem Complex relationships in real-world data cannot be adequately modeled by linear interactions.
method Introduces Higher Order Reduced Rank Regression (HORRR) using tensor representations and Tucker decomposition.
result HORRR can capture nonlinear interactions in multi-response regression.

Transformers are explained as infinite-dimensional kernel machines.

problem Understanding the mechanics of Transformers in AI.
method Characterized Transformers' attention mechanism as a kernel learning method on Banach spaces.
result Transformer's kernel has infinite feature dimension and can learn any binary non-Mercer reproducing kernel Banach space pair.

VED framework learns low-dimensional latent representations of physical systems.

problem Learning latent representations of complex physical systems.
method Variational Encoder-Decoder (VED) framework with KL divergence and covariance regularization.
result VED achieves lower-dimensional latent representations with improved feature disentanglement.

In machine learning and data mining, linear models have been widely used to model the response as parametric linear functions of the predictors. To relax such stringent assumptions made by parametric linear models, additive models consider the response to be a summation of unknown transformations applied on the predict…

2017-10-16abs ↗pdf ↗

Current multi-view factorization methods make assumptions that are not acceptable for many kinds of data, and in particular, for graphical data with hierarchical structure. At the same time, current hierarchical methods work only in the single-view setting. We generalize the Treelet Transform to the Multi-View Treelet …

2016-06-02abs ↗pdf ↗

New analysis shows how cross-entropy training shapes attention in transformers.

problem Understanding how gradient-based learning creates the required internal geometry in transformers.
method Developed a first-order analysis of cross-entropy training effects on attention scores and values in a transformer attention head.
result Introduced an advantage-based routing law and responsibility-weighted update for attention scores and values, respectively.

Controlled interventions provide the most direct source of information for learning causal effects. In particular, a dose-response curve can be learned by varying the treatment level and observing the corresponding outcomes. However, interventions can be expensive and time-consuming. Observational data, where the treat…

2016-05-05abs ↗pdf ↗

Neural network predicts functional responses from scalar inputs.

problem Regression of functional responses with large scalar predictors and nonlinear relationships.
method Transform functional response to finite dimensions, design feed-forward neural network, modify output via objective functions, apply roughness penalty.
result Proposed neural network outperforms conventional methods in multiple scenarios.

Study develops ensemble machine learning framework for predicting groundwater heavy metal pollution.

problem Statistical complexity and spatial heterogeneity of heavy metal contamination in groundwater.
method Nested cross-validated ensemble machine learning with response transformations (raw, log, Gaussian copula).
result Copula-based models with DBSCAN clustering diagnostics provide the most reliable and interpretable assessments of groundwater contamination.

Theoretical analysis shows LLMs can self-correct responses through in-context learning.

problem Understanding how large language models improve through self-correction.
method Theoretical analysis based on simplified alignment task, focusing on softmax attention, multi-head attention, and MLP blocks.
result LLMs can refine responses in an in-context way when given accurate self-examinations as rewards.

FCOC framework improves financial volatility forecasting.

problem Tackles dual challenges of feature fidelity and model responsiveness in financial volatility forecasting.
method Synergizes fractal feature extraction and dynamic chaotic oscillation processing.
result Demonstrates profound and generalizable impact on S\&P 500 and DJI datasets.

SKI speeds up Toeplitz Neural Networks by avoiding explicit decay bias and using frequency response.

problem Efficiently compute and update Toeplitz matrices in neural networks.
method Sparse plus low-rank decomposition, asymmetric SKI, frequency response modeling.
result Achieved significant speedup with minimal performance loss.

This paper introduces a novel recalibration method for multivariate forecasts.

problem Multivariate calibration for potentially misspecified models.
method Local mappings between marginal probability integral transform values and observed space, using K-nearest neighbors or normalizing flows.
result Demonstrated effectiveness on currency exchange rate and childhood malnutrition data.

SAMformer improves transformer performance in time series forecasting.

problem Transformers struggle with multivariate long-term forecasting.
method Sharpness-aware minimization and channel-wise attention.
result SAMformer surpasses state-of-the-art methods in multivariate time series forecasting.

Random forests is a common non-parametric regression technique which performs well for mixed-type data and irrelevant covariates, while being robust to monotonic variable transformations. Existing random forest implementations target regression or classification. We introduce the RFCDE package for fitting random forest…

2018-04-16abs ↗pdf ↗

Novel Bayesian model improves EEG-based BCI character selection.

problem Accurately identifying target-related responses in EEG-based BCIs.
method Probit-link Split-and-merge Gaussian Process (P-SMGP) prior for feature selection.
result Reduces computational complexity and provides interpretable statistical interpretations.

Paper proposes linear transformers for efficient in-context learning without context length limitations.

problem Quadratic complexity of softmax transformers limits data processing speed.
method Investigates linear transformers under domain generalization, showing they learn mappings from context distributions to response functions.
result Linear transformers achieve in-context learning with a linear complexity in context length, offering a dimension-independent convergence rate.

RLGP model improves robustness and accuracy for discontinuous response surfaces.

problem Challenges in modeling abrupt jumps and discontinuities in response surfaces.
method Integrates adaptive nearest-neighbor selection with robustification mechanism.
result Consistently delivers high predictive accuracy and robustness in higher dimensions.

Adaptive TFTs improve cryptocurrency price prediction accuracy.

problem Precise short-term price prediction in volatile cryptocurrency markets.
method Dynamic subseries lengths and pattern-based categorization.
result Significantly outperforms baseline models in prediction accuracy and profitability.

Different neural networks trained on the same dataset often learn similar input-output mappings with very different weights. Is there some correspondence between these neural network solutions? For linear networks, it has been shown that different instances of the same network architecture encode the same representatio…

2018-11-28abs ↗pdf ↗

Study proposes adaptive RL for dynamic portfolio optimization.

problem Traditional portfolio optimization models fail to adapt to regime shifts.
method Regime-aware reinforcement learning framework with hybrid observations and constrained reward functions.
result Transformer PPO achieves highest risk-adjusted returns, while LSTM variants offer a good balance.

Proposes a method to create shorter, more accurate prediction intervals.

problem Challenges in achieving both conditional validity and interval efficiency in complex settings.
method Uses a conformal-style calibration method for neural network responses, adjusting to empirical PIT distribution.
result Demonstrates better conditional calibration and shorter intervals than existing methods.

CSHT predicts financial returns from news using a novel transformer model on a sphere.

problem Financial forecasting from news and sentiment.
method Granger-causal hypergraph structure, Riemannian geometry, causally masked Transformer attention.
result CSHT outperforms baselines in return prediction, regime classification, and asset ranking.

New Performer model tackles long-sequence protein modeling.

problem Challenges of training complex Transformer models for long sequences.
method Linearly scalable long-context Transformer architecture, Performer.
result Performer provides strong theoretical guarantees and is effective for protein sequence modeling.

We propose methods for estimating correspondence between two point sets under the presence of outliers in both the source and target sets. The proposed algorithms expand upon the theory of the regression without correspondence problem to estimate transformation coefficients using unordered multisets of covariates and r…

2019-06-01abs ↗pdf ↗

CogFormer trains a transformer to estimate parameters across various cognitive models.

problem Difficulty in fitting complex cognitive models and iterating over varying assumptions.
method Meta-amortized framework using a transformer to estimate parameters across multiple models.
result CogFormer accurately estimates parameters across different model families with minimal retraining.

A new method for unfolding histograms without matrix inversion.

problem Matrix inversion in experimental physics, especially in high-energy particle physics.
method Sampling many distributions, folding them through the response matrix, and choosing the closest one to the data.
result Performs as well as traditional methods in well-defined inverse problems and outperforms them in ill-defined ones.

To model categorical response variables given their covariates, we propose a permuted and augmented stick-breaking (paSB) construction that one-to-one maps the observed categories to randomly permuted latent sticks. This new construction transforms multinomial regression into regression analysis of stick-specific binar…

2016-12-30abs ↗pdf ↗

New method identifies shared topics in LLM inputs and outputs for better detection of hallucinations.

problem Detecting semantic drift in LLM responses from context.
method Transformed Deterministic Information Bottleneck (DIB) into UDIB for high-dimensional data.
result UDIB generates more informative topic representations for SDM, improving hallucination detection.