Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

132265397529 · Jun 202019922001200920172026
48 results for doubly stochastic objectives

Doubly-stochastic normalization improves robustness to heteroskedastic noise.

problem Robustness to heteroskedastic noise in affinity matrix construction.
method Doubly-stochastic normalization of the Gaussian kernel.
result Doubly-stochastic normalization converges to clean matrix with rate m1/2m^{-1/2} under heteroskedastic noise.

We propose an efficient method for estimating covariate effects in doubly-stochastic spatial models.

problem Computational demands and restrictive assumptions in existing doubly-stochastic spatial models.
method Penalized regression method for estimating covariate effects in doubly-stochastic point processes.
result Consistency and asymptotic normality of the covariate effect estimates achieved despite model misspecification.

This technical report proves components consistency for the Doubly Stochastic Dirichlet Process with exponential convergence of posterior probability. We also present the fundamental properties for DSDP as well as inference algorithms. Simulation toy experiment and real-world experiment results for single and multi-clu…

2016-05-24abs ↗pdf ↗

Paper proposes Sinkformers for Transformers with doubly stochastic attention.

problem Improving Transformer models' accuracy in vision and natural language processing.
method Using Sinkhorn's algorithm to make attention matrices doubly stochastic instead of SoftMax normalization.
result Sinkformers enhance model accuracy in vision and natural language processing tasks.

Proposes a new simulator for complex arrival processes.

problem Modeling and simulating complex arrival processes with non-stationary and multi-dimensional rates.
method Integrates Monte Carlo and GANs to model a broad class of arrival processes.
result Consistent and efficient estimation of the simulator using Wasserstein distance.

In this letter, we introduce a distributed Nesterov method, termed as ABN\mathcal{ABN}, that does not require doubly-stochastic weight matrices. Instead, the implementation is based on a simultaneous application of both row- and column-stochastic weights that makes this method applicable to arbitrary (strongly-connected…

2019-01-21abs ↗pdf ↗

An interesting theme in complex differential geometry is to find a correspondence between algebraic objects and differential geometric objects. One of the most attractive is the non-abelian Hodge theory of Simpson. In this paper, pursuing an analogue of the non-abelian Hodge theory in the context of qq-difference modu…

2019-02-10abs ↗pdf ↗

FDSKL algorithm trains vertically partitioned data with kernels securely and efficiently.

problem Training vertically partitioned data with kernels while maintaining privacy.
method FDSKL algorithm using random features and doubly stochastic gradients for federated learning.
result FDSKL achieves sublinear convergence and guarantees data security.

Geometric approach for unsupervised word embedding alignment.

problem Learning alignment between word embeddings of source and target languages.
method Formulates alignment as domain adaptation on the manifold of doubly stochastic matrices, employing Riemannian conjugate gradient algorithm.
result Empirically outperforms state-of-the-art methods on bilingual lexicon induction tasks.

This paper discusses properties of a Doubly Stochastic Poisson Process (DSPP) where the intensity process belongs to a class of affine diffusions. For any intensity process from this class we derive an analytical expression for probability distribution functions of the corresponding DSPP. A specification of our results…

2011-09-13abs ↗pdf ↗

The paper improves boundary detection and density estimation on noisy data.

problem Detecting boundary points and estimating density on noisy data from compact manifolds.
method Doubly stochastic scaling of the Gaussian heat kernel via Sinkhorn iterations.
result The new estimates of boundary points and density outperform standard methods, especially under noise.

When training a machine learning model with observational data, it is often encountered that some values are systemically missing. Learning from the incomplete data in which the missingness depends on some covariates may lead to biased estimation of parameters and even harm the fairness of decision outcome. This paper …

2018-12-21abs ↗pdf ↗

Doubly stochastic learning algorithms are scalable kernel methods that perform very well in practice. However, their generalization properties are not well understood and their analysis is challenging since the corresponding learning sequence may not be in the hypothesis space induced by the kernel. In this paper, we p…

2017-07-03abs ↗pdf ↗

Robustly infers manifold density and geometry under high-dimensional noise.

problem Inaccurate kernel density estimation under high-dimensional noise.
method Doubly stochastic normalization of Gaussian kernel.
result Robust tools for density estimation, noise magnitude estimation, and distance approximation.

Doubly robust self-training improves semi-supervised learning by balancing labeled and pseudo-labeled data.

problem Improving semi-supervised learning performance with limited labeled data.
method Introduces doubly robust self-training, a method that combines labeled and pseudo-labeled data to balance between labeled-only and pseudo-labeled-only training.
result Demonstrates superior performance of doubly robust self-training on ImageNet and nuScenes datasets.

DSVNP uses global and local latent variables for improved neural process predictions.

problem Limited expressiveness of vanilla neural processes in capturing target-specific local variation.
method Introduces DSVNP combining global and local latent variables for prediction.
result Competitive prediction performance in multi-output regression and uncertainty estimation.

It is of increasing importance to develop learning methods for ranking. In contrast to many learning objectives, however, the ranking problem presents difficulties due to the fact that the space of permutations is not smooth. In this paper, we examine the class of rank-linear objective functions, which includes popular…

2011-06-09abs ↗pdf ↗

The general perception is that kernel methods are not scalable, and neural nets are the methods of choice for nonlinear learning problems. Or have we simply not tried hard enough for kernel methods? Here we propose an approach that scales up kernel methods using a novel concept called "doubly stochastic functional grad…

2014-07-21abs ↗pdf ↗

We introduce a doubly stochastic proximal gradient algorithm for optimizing a finite average of smooth convex functions, whose gradients depend on numerically expensive expectations. Our main motivation is the acceleration of the optimization of the regularized Cox partial-likelihood (the core model used in survival an…

2015-10-16abs ↗pdf ↗

Graph alignment problem solved with convex relaxations for correlated matrices.

problem Recovering hidden vertex permutations from correlated Gaussian matrices.
method Convex relaxations of the quadratic assignment problem over doubly stochastic matrices.
result The solution of the convex relaxation concentrates around the ground-truth permutation matrix for certain correlation parameters.

Gaussian processes (GPs) are a good choice for function approximation as they are flexible, robust to over-fitting, and provide well-calibrated predictive uncertainty. Deep Gaussian processes (DGPs) are multi-layer generalisations of GPs, but inference in these models has proved challenging. Existing approaches to infe…

2017-05-24abs ↗pdf ↗

ADSGD method speeds up model identification in sparse optimization.

problem Implicit model identification in sparse optimization problems.
method Accelerated Doubly Stochastic Gradient Method (ADSGD) for faster explicit model identification.
result ADSGD achieves faster explicit model identification and improved algorithm efficiency.

π-GNN learns soft permutations for graph representations, improving graph classification and regression.

problem Limitations of MPNNs in graph neural networks.
method Proposes π-GNN, which learns a soft permutation matrix for each graph, projecting graphs into a common vector space.
result π-GNN achieves performance competitive with state-of-the-art models on graph classification and regression tasks.

This work concerns the study of certain finite-energy solutions of the anti-self-dual Yang-Mills equations on Euclidean 4-dimensional space which are periodic in two directions, so-called doubly-periodic instantons. We establish a circle of ideas involving equivalent analytical and algebraic-geometric descriptions of t…

1999-12-04abs ↗pdf ↗

The paper tackles robust policy learning from multiple data sources.

problem Learning a policy that generalizes across diverse settings from multiple heterogeneous data sources.
method Proposes a minimax regret optimization objective and a policy learning algorithm combining doubly robust offline policy evaluation and no-regret learning.
result Achieves minimal worst-case mixture regret up to a moderated vanishing rate of the total data across all sources.

DoubleGen addresses bias in generative modeling of counterfactuals.

problem Bias in generative models for counterfactual outcomes.
method Doubly robust framework that modifies generative modeling training objectives to mitigate confounding and misspecification biases.
result Successfully addresses confounding bias even if only one auxiliary model is correct.

Accelerates Birkhoff projection for manifold-constrained hyper-connections with high accuracy and speed.

problem Inaccurate and slow Birkhoff projection in mHC implementations.
method Dual formulation, Newton's method, implicit differentiation, warp-level CUDA kernel.
result Substantial speedups and accuracy improvements in doubly stochastic projections.

Contextual multi-armed bandit algorithms are widely used in sequential decision tasks such as news article recommendation systems, web page ad placement algorithms, and mobile health. Most of the existing algorithms have regret proportional to a polynomial function of the context dimension, dd. In many applications ho…

2019-07-26abs ↗pdf ↗

The paper examines Einstein doubly warped product manifolds with a semi-symmetric metric connection.

problem Characterizing Einstein doubly warped product manifolds with a semi-symmetric metric connection.
method Deriving curvature formulas and proving necessary and sufficient conditions for a manifold to be a warped product.
result Obtained results for Einstein doubly warped product manifolds and Einstein-like doubly warped product manifolds.

Enhances DGPs with adaptive RKHS Fourier features for better non-stationary pattern modeling.

problem Capturing complex non-stationary patterns in non-linear dynamical systems.
method Integrates ODE-based RKHS Fourier features into DGPs using convolution operations for adaptive amplitude and phase modulation. Uses a doubly stochastic variational inference framework.
result Improved predictive performance across various regression tasks.

Characterizes and examines gradient solitons on doubly warped product manifolds.

problem Understanding gradient solitons on specific manifold structures.
method Characterizations and examinations of various types of gradient solitons on doubly warped product manifolds.
result Effects of gradient solitons on factor manifolds and specific curvature properties of doubly warped products.

Paper extends causal inference to non-Euclidean data like images and distributions.

problem Causal inference for non-Euclidean data like images and distributions.
method Hilbert space embeddings, Fréchet mean estimation, nonparametric doubly-debiased causal inference.
result Validated approach for causal inference with continuous treatments on non-Euclidean data.