We discuss the use of Dirac structures to obtain a better understanding of the geometry of a class of optimal control problems and their reduction by symmetries. In particular we will show how to extend the reduction of Dirac structures recently proposed by Yoshimura and Marsden [Yo09] to describe the reduction of a cl…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “Problem Reduction”
In statistical learning, many problem formulations have been proposed so far, such as multi-class learning, complementarily labeled learning, multi-label learning, multi-task learning, which provide theoretical models for various real-world tasks. Although they have been extensively studied, the relationship among them…
PSMM method optimizes matrix sufficient dimension reduction.
problem Feature matrices with row- and column-wise interpretations require efficient dimension reduction.
method PSMM method converts matrix problem into classification problems using rank-1 normal matrix.
result PSMM outperforms existing methods and provides strong interpretability.
Constructs singular Yamabe solutions via equivariant reduction.
problem Constructs non-trivial geometric examples for the Yamabe equation.
method Reduces the problem to an equivariant setting for simpler analysis.
result Provides a non-trivial weak solution to the Yamabe problem.
Paper identifies reductive MDPs, solving them in polynomial time.
problem Computational hardness of general MDPs and tractability of finite-horizon MDPs.
method Defines reductivity, a new class of SSPs, and develops a polynomial-time solution.
result Optimal policies can be found in polynomial time for reductive SSPs and MDPs.
We construct the hyperbolic plane with its geodesic flow as the scale plus symmetry reduction of a three-body problem in the Euclidean plane. The potential is where is the triangle's moment of inertia and its area. The reduction method uses the Jacobi-Maupertuis metric, following the author's earlier p…
Efficiently transforms samples from various statistical models.
problem Approximately transforming samples from one statistical model to another without knowing the source model's parameters.
method Constructs computationally efficient procedures to reduce uniform, Erlang, and Laplace models to general target families.
result Establishes nonasymptotic reductions between canonical high-dimensional problems, such as mixtures of experts, phase retrieval, and signal denoising.
An analogue of geometric quantization of Poisson algebras obtained by algebraic reduction of symmetries is developed. Interpretation of the obtained results and their application to the problem of commutativity of quantization and reduction are given
Distributional Reduction: Unifying Dimensionality Reduction and Clustering with Gromov-Wassersteincs.LG
Unified framework for DR and clustering using Gromov-Wasserstein.
problem Capturing structure in high-dimensional datasets.
method Distributional reduction framework using Gromov-Wasserstein.
result Unified approach recovers DR and clustering as special cases.
This article addresses the problem of developing an extension of the Marsden- Weinstein reduction process to symplectic Lie algebroids, and in particular to the case of the symplectic cover of a fiberwise linear Poisson structure, whose reduction process is the analogue to cotangent bundle reduction in the context of L…
Investigates solving curvature equations on special Lie groups.
problem Solving curvature equations on non-compact simple Lie groups.
method Analyzes left-invariant naturally reductive metrics and conditions for solvability.
result Obtains conditions for the solvability of curvature equations.
New method reduces version space for CNNs, improving active learning performance.
problem Sampling bias in active learning hinders optimal hypothesis finding in neural networks.
method Version space reduction through prior mass reduction and diameter reduction, proposing a new Gibbs-vote disagreement method.
result Diameter-based querying method reduces version space more effectively than prior mass reduction and other methods.
We survey the role of symmetry in diffeomorphic registration of landmarks, curves, surfaces, images and higher-order data. The infinite dimensional problem of finding correspondences between objects can for a range of concrete data types be reduced resulting in compact representations of shape and spatial structure. Th…
New algorithm reduces optimization complexity in adaptive mirror descent.
problem Optimizing complex, non-smooth, non-convex functions efficiently.
method SVRAMD: Variance Reduced Adaptive Mirror Descent.
result Variance reduction accelerates convergence in adaptive mirror descent.
Adapts DR objectives for both sample and feature size reduction.
problem Simultaneously reduce sample and feature sizes.
method Semi-relaxed Gromov-Wasserstein optimal transport.
result OT plan delivers competitive hard clustering.
It is an important problem in differential geometry to find non-naturally reductive homogeneous Einstein metrics on homogeneous manifolds. In this paper, we consider this problem for some coset spaces of compact simple Lie groups. A new method to construct invariant non-naturally reductive Einstein metrics on normal ho…
Extends dimension reduction to data-driven settings without gradients.
problem Gradient-based dimension reduction limitations in data-driven settings.
method Score ratio matching framework, tailored parameterization, regularization, eigenvalue deflation.
result Outperforms standard score-matching for problems with low-dimensional structure.
New algorithms reduce variance in solving complex mathematical problems.
problem Solving convex-concave saddle point problems, variational inequalities, and inclusions.
method Stochastic variance reduction for extragradient, forward-backward-forward, and forward-reflected-backward methods.
result All proposed methods converge with complexities matching or improving deterministic counterparts.
We study the problem of prescribing the Ricci curvature in the class of naturally reductive metrics on a compact Lie group. We derive necessary as well as sufficient conditions for the solvability of the equations and provide a series of examples.
SignSVRG improves SignSGD by reducing variance, achieving similar convergence rates.
problem Minimizing finite sums of convex and Lipschitz functions.
method Incorporates variance reduction techniques into SignSGD.
result Achieves convergence rates of for expected norm of the gradient and for smooth convex functions.
Identifies a gradient flow to solve kernel learning problems with noise reduction.
problem Kernel learning problem with Gaussian noise.
method Riemannian gradient flow with continuous Lyapunov functionals.
result Flow reduces noise and finds stationary points.
We consider natural differential operations acting on sections of tensor vector bundles. Arrising problems can be reformulated as invariant theoretical problems (the IT-reduction). We give examples of usage of the IT-reduction. In particular, on a manifold with a connection and a Poisson structure we construct the cano…
The process of un-reduction, a sort of reversal of reduction by the Lie group symmetries of a variational problem, is explored in the setting of field theories. This process is applied to the problem of curve matching in the plane, when the curves depend on more than one independent variable. This situation occurs in a…
Reduces field theories on principal bundles by a subgroup, deriving reduced equations.
problem Hamiltonian field theories on principal G-bundles with invariant densities.
method Lie-Poisson reduction using covariant bracket formulation.
result Derives reduced observables, brackets, and equations of motion for field theories.
This work improves understanding of dimension reduction algorithms and their probabilistic embeddings.
problem Improving theoretical understanding of non-linear dimension reduction algorithms.
method Analytical investigation of a generalized multidimensional scaling optimization problem.
result Probabilistic formulation of the problem leads to deterministic embeddings, contrary to standard implementations.
We study control systems invariant under a Lie group with application to the problem of nonlinear trajectory planning. A theory of symmetry reduction of exterior differential systems is employed to demonstrate how symmetry reduction and reconstruction is effective in the explicit, exact construction of planned system t…
New insights link diverse statistical problems via secret leakage planted clique.
problem Statistical-computational gaps in inference problems.
method Secret leakage planted clique as a new hardness assumption for reductions.
result Establishes tight statistical-computational tradeoffs for various problems.
This paper addresses overfitting in dimension reduction methods by calibrating hyperparameters considering noise.
problem Overfitting in dimension reduction methods, especially t-SNE and UMAP, when data contains noise.
method Present a framework to calibrate hyperparameters in the presence of noise for t-SNE and UMAP.
result Recommended hyperparameter values for t-SNE and UMAP are too small and overfit the noise.
Reduces energy for 4D submanifolds in R^n.
problem Energy reduction for 4D submanifolds in R^n.
method Connected sum energy reduction for fourth-order Willmore energy.
result Established a connected sum energy reduction for the fourth-order Willmore energy.
The un-reduction procedure introduced previously in the context of Mechanics is extended to covariant Field Theory. The new covariant un-reduction procedure is applied to the problem of shape matching of images which depend on more than one independent variable (for instance, time and an additional labelling parameter)…
The main purpose of the following article is to introduce a \emph{Lie theoretical} approach to the problem of classifying pseudo quaternionic-Kähler (QK) reductions of the pseudo QK symmetric spaces, otherwise called \emph{generalized Wolf spaces}.
Consensus dimension reduction combines multiple visualizations to identify shared patterns.
problem Conflicting visualizations from different dimension reduction methods.
method Multi-view learning to identify stable patterns across multiple views.
result Consensus visualization effectively identifies shared low-dimensional data structure.
Can one reduce the size of a graph without significantly altering its basic properties? The graph reduction problem is hereby approached from the perspective of restricted spectral approximation, a modification of the spectral similarity measure used for graph sparsification. This choice is motivated by the observation…
Reduces IB problem to a simpler, lower-dimensional problem.
problem Information bottleneck problem in high-dimensional spaces.
method Identifies sufficient statistic that factors conditional distribution, reducing IB to a lower-dimensional problem.
result Preserves full IB curve and optimal representations, making IB tractable.
Drago: Primal-Dual Coupled Variance Reduction for Faster Distributionally Robust Optimizationstat.ML
Drago optimizes DRO problems with faster convergence.
problem Distributionally robust optimization with closed, convex uncertainty sets.
method Primal-dual coupled variance reduction algorithm with cyclic and randomized updates.
result Achieves state-of-the-art linear convergence rate on strongly convex-strongly concave problems.
This report concerns the problem of dimensionality reduction through information geometric methods on statistical manifolds. While there has been considerable work recently presented regarding dimensionality reduction for the purposes of learning tasks such as classification, clustering, and visualization, these method…
A new method using energy distance for ensemble and scenario reduction.
problem Solving complex dynamic and stochastic programs, especially in energy systems.
method Proposes a new method based on energy distance for ensemble and scenario reduction.
result Reduced scenario sets exhibit better statistical properties for energy distance than Wasserstein distance.
We reframe linear dimensionality reduction as a problem of Bayesian inference on matrix manifolds. This natural paradigm extends the Bayesian framework to dimensionality reduction tasks in higher dimensions with simpler models at greater speeds. Here an orthogonal basis is treated as a single point on a manifold and is…
It is difficult to find the optimal sparse solution of a manifold learning based dimensionality reduction algorithm. The lasso or the elastic net penalized manifold learning based dimensionality reduction is not directly a lasso penalized least square problem and thus the least angle regression (LARS) (Efron et al. \ci…
Paper proposes conditional multidimensional scaling for better data reduction.
problem Mapping high-dimensional data to low-dimensional space with known features.
method Developed a broad class of methods called conditional multidimensional scaling (MDS) with an optimization algorithm.
result Conditional MDS improves estimation quality and simplifies visualization and knowledge discovery.
We consider an enlarged dimension reduction space in functional inverse regression. Our operator and functional analysis based approach facilitates a compact and rigorous formulation of the functional inverse regression problem. It also enables us to expand the possible space where the dimension reduction functions bel…
Study nonholonomic systems with collisions using variational principles.
problem Variational problems on nonholonomic systems with collisions.
method Extended variational principle, introduced connection on principal bundles, applied Lagrange–Poincaré–Pontryagin reduction.
result Implicit Lagrange–d'Alembert–Pontryagin equations for nonholonomic systems with collisions.
In the paper we introduce a boundary value problem for a G_{2} structure on a 7-manifold with boundary, with prescribed 3-form on the boundary. We make some general observations about this problem and then study in more detail reductions to 4 and 3 dimensions by imposing symmetry. The 3-dimensional reduction admits a d…
Scalability of statistical estimators is of increasing importance in modern applications and dimension reduction is often used to extract relevant information from data. A variety of popular dimension reduction approaches can be framed as symmetric generalized eigendecomposition problems. In this paper we outline how t…
Dictionary leaning (DL) and dimensionality reduction (DR) are powerful tools to analyze high-dimensional noisy signals. This paper presents a proposal of a novel Riemannian joint dimensionality reduction and dictionary learning (R-JDRDL) on symmetric positive definite (SPD) manifolds for classification tasks. The joint…
Proposes an online method for high-dimensional streaming data.
problem Increasing variable dimensions with sample size in online kernel sliced inverse regression.
method Introduces approximate linear dependence condition and dictionary variable sets to address the problem. Transforms into online generalized eigen-decomposition problem and uses stochastic optimization for updates.
result Achieves close performance to batch processing kernel sliced inverse regression.
We consider the problem of sufficient dimensionality reduction (SDR), where the high-dimensional observation is transformed to a low-dimensional sub-space in which the information of the observations regarding the label variable is preserved. We propose DVSDR, a deep variational approach for sufficient dimensionality r…
Large textual corpora are often represented by the document-term frequency matrix whose elements are the frequency of terms; however, this matrix has two problems: sparsity and high dimensionality. Four dimension reduction strategies are used to address these problems. Of the four strategies, unsupervised feature trans…