Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

4488131175 · Jun 202019922001200920172026
48 results for matrix rounding

In spectral clustering, one defines a similarity matrix for a collection of data points, transforms the matrix to get the Laplacian matrix, finds the eigenvectors of the Laplacian matrix, and obtains a partition of the data using the leading eigenvectors. The last step is sometimes referred to as rounding, where one ne…

2012-10-16abs ↗pdf ↗

Matrix factorization is a well-studied task in machine learning for compactly representing large, noisy data. In our approach, instead of using the traditional concept of matrix rank, we define a new notion of link-rank based on a non-linear link function used within factorization. In particular, by applying the round …

2018-05-01abs ↗pdf ↗

We study the problem of repeated play in a zero-sum game in which the payoff matrix may change, in a possibly adversarial fashion, on each round; we call these Online Matrix Games. Finding the Nash Equilibrium (NE) of a two player zero-sum game is core to many problems in statistics, optimization, and economics, and fo…

2019-07-17abs ↗pdf ↗

Two efficient algorithms improve online item recommendation for large user-item matrices.

problem Low rank matrix completion in an online setting with noisy rewards.
method Phased algorithms extsc{PhasedClusterElim} and extsc{DeterminantElim} for item recommendation.
result Near-optimal per-user regret guarantees for item recommendation.

Optimal algorithm for latent bandits with cluster structure reduces regret to nearly optimal.

problem Maximizing cumulative rewards in a multi-armed bandit problem with latent clusters.
method LATTICE algorithm exploiting cluster structure and arm information.
result Minimax optimal regret of O((M+N)T)O(\sqrt{(\mathsf{M}+\mathsf{N})\mathsf{T}}) with O(logT)O(\log{\mathsf{T}}) calls to matrix completion oracle.

Paper develops a distributed debiased estimator for sparse statistical inference.

problem High computational costs in debiased estimator construction for high-dimensional models.
method Develops a multi-round distributed debiased estimator using both labeled and unlabelled data.
result Unlabeled data improves statistical rate of each iteration in distributed setup.

Method predicts future rewards from past actions in a linear Gaussian system.

problem Maximizing cumulative reward in a stochastic multi-armed bandit with linear Gaussian dynamics.
method Proposes a method using a modified Kalman filter to predict future rewards based on past rewards.
result Reward from any action can be used to predict another action's future reward.

PACE-GGM uses Gaussian mechanism for private covariance estimation.

problem Private estimation of covariance matrices in high dimensions.
method Data-adaptive selection of entries, Gaussian mechanism, maximum-entropy reconstruction.
result Consistent improvements in estimation error compared to Gaussian mechanism and baselines.

FLANDERS detects and blocks extreme model poisoning in federated learning.

problem Resilience against large-scale model poisoning attacks in federated learning.
method FLANDERS treats client updates as matrix-valued time series and identifies outliers using autoregressive forecasting.
result FLANDERS significantly improves robustness in federated learning across various attacks.

New method reduces linear regret in high-dimensional bandit problems.

problem Heavy spectral tails in streaming matrices lead to linear regret in sketch-based linear bandits.
method Dyadic Block Sketching, a multi-scale matrix sketching approach.
result Achieves sublinear regret bounds without prior knowledge of streaming matrix properties.

A new method uses matrix sketches for efficient graph clustering in dynamic environments.

problem Efficiently clustering large, dynamic graphs in distributed memory systems.
method Inspired by spectral clustering, the approach uses random dimension-reducing projections to derive matrix sketches.
result The method produces embeddings that yield performant clustering results in a fully-dynamic stochastic block model stream.

Gradient descent with biased rounding errors converges faster under certain conditions.

problem Stagnation or negative impact of rounding errors in neural network training with low precision.
method Analysis of gradient descent with stochastic fixed-point rounding errors under the Polyak-Lojasiewicz inequality.
result Biased rounding errors can improve convergence rates, especially when the Polyak-Lojasiewicz inequality holds.

In distributed systems, communication is a major concern due to issues such as its vulnerability or efficiency. In this paper, we are interested in estimating sparse inverse covariance matrices when samples are distributed into different machines. We address communication efficiency by proposing a method where, in a si…

2016-05-03abs ↗pdf ↗

Contact round surgeries on (S3,ξst)(\mathbb{S}^3,ξ_{st}) help in constructing and understanding contact 3-manifolds.

problem Constructing contact 3-manifolds using Legendrian surgeries.
method Introducing contact round surgeries of indices 1 and 2, and associating them with surgery diagrams.
result Every closed connected contact 3-manifold can be obtained by a sequence of contact round surgeries on Legendrian knots in (S3,ξst)(\mathbb{S}^3,ξ_{st}).

In this article, we extend Huisken's theorem that convex surfaces flow to round points by mean curvature flow. We construct certain classes of mean convex and non-mean convex hypersurfaces that shrink to round points and use these constructions to create pathological examples of flows. We find a sequence of flows that …

2019-01-09abs ↗pdf ↗

Optimizes sample and round complexity in adaptive sampling from multiple distributions.

problem Adaptive sampling from multiple distributions with limited rounds and samples.
method Introduces OODS framework and analyzes tradeoffs between sample and round complexity.
result Achieves near-optimal sample complexity and sub-polynomial round complexity.

Consider an analytic map of a neighborhood of 0 in a vector space to a Euclidean space. Suppose that this map takes all germs of lines passing through 0 to germs of circles. Such a map is called rounding. We introduce a natural equivalence relation on roundings and prove that any rounding, whose differential at 0 has r…

2002-12-06abs ↗pdf ↗

This work investigates how multi-round reasoning improves LLM performance.

problem Improving problem-solving abilities in complex tasks with LLMs.
method Investigates approximation, learnability, and generalization properties of multi-round auto-regressive models.
result Transformers with finite context windows are universal approximators for Turing-computable functions and can approximate any Turing-computable sequence-to-sequence function through multi-round reasoning.

Due to the rapid growth of data and computational resources, distributed optimization has become an active research area in recent years. While first-order methods seem to dominate the field, second-order methods are nevertheless attractive as they potentially require fewer communication rounds to converge. However, th…

2018-06-20abs ↗pdf ↗

We consider a stochastic continuum armed bandit problem where the arms are indexed by the 2\ell_2 ball Bd(1+ν)B_{d}(1+ν) of radius 1+ν1+ν in Rd\mathbb{R}^d. The reward functions r:Bd(1+ν)Rr :B_{d}(1+ν) \rightarrow \mathbb{R} are considered to intrinsically depend on kdk \ll d unknown linear parameters so that $r(\mathbf{x}) = g(\ma…

2013-12-01abs ↗pdf ↗

Gradient descent stagnates in low-precision, but unbiased rounding schemes improve convergence.

problem Stagnation of gradient descent in low-precision computation.
method Proposed unbiased stochastic rounding schemes that trade zero bias for larger probability of preserving small gradients.
result Unbiased rounding methods typically improve convergence rate of gradient descent for convex problems.

A new method for distributed optimization reduces communication rounds without minibatches.

problem Efficient training in distributed machine learning with different data distributions.
method A primal-dual method (GA-MSGD) applied to the Lagrangian of distributed optimization.
result Achieves linear convergence in communication rounds for strongly convex objectives.

A half-geodesic is a closed geodesic realizing the distance between any pair of its points. All geodesics in a round sphere are half-geodesics. Conversely, this note establishes that Riemannian spheres with all geodesics closed and sufficiently many half-geodesics are round.

2019-04-27abs ↗pdf ↗

The study characterizes round spheres in Euclidean space based on r-mean curvature conditions.

problem Characterizing round spheres in Euclidean space under specific curvature conditions.
method Characterization based on r-mean curvature conditions.
result Characterizes round spheres in Euclidean space under suitable r-mean curvature conditions.

Contact round surgery of contact 3-manifolds is introduced in this paper. By using this method, an alternative proof of the existence of a contact structure on any closed orientable 3-manifold is given. It is also proved that any contact structure on any closed orientable 3-manifold is constructed from the standard con…

2017-03-12abs ↗pdf ↗

Study cohomology rings of 3D manifolds with round fold maps into the plane.

problem Understanding cohomology rings of 3D manifolds with round fold maps.
method Analyzing cohomology rings of 3D manifolds admitting round fold maps into the plane.
result Explicit new study showing relation between coefficient rings and topological types of round fold maps.