arXiv research

We introduce a new multi-dimensional nonlinear embedding -- Piecewise Flat Embedding (PFE) -- for image segmentation. Based on the theory of sparse signal recovery, piecewise flat embedding with diverse channels attempts to recover a piecewise constant image representation with sparse region boundaries and sparse clust…

New method unifies and formalizes data partitioning using a single vector.

Piecewise constant denoising can be solved either by deterministic optimization approaches, based on the Potts model, or by stochastic Bayesian procedures. The former lead to low computational time but require the selection of a regularization parameter, whose value significantly impacts the achieved solution, and whos…

We present the group fused Lasso for detection of multiple change-points shared by a set of co-occurring one-dimensional signals. Change-points are detected by approximating the original signals with a constraint on the multidimensional total variation, leading to piecewise-constant approximations. Fast algorithms are …

Study identifies change points in piecewise constant reward functions with fixed exploration budget.

We consider a class of linear-programming based estimators in reconstructing a sparse signal from linear measurements. Specific formulations of the reconstruction problem considered here include Dantzig selector, basis pursuit (for the case in which the measurements contain no errors), and the fused Dantzig selector (f…

The fused lasso is analyzed for high-dimensional piecewise-constant regression coefficients.

Proposes a new graph trend filtering model for inhomogeneous graph signals.

We consider estimating a piecewise-constant image, or a gradient-sparse signal on a general graph, from noisy linear measurements. We propose and study an iterative algorithm to minimize a penalized least-squares objective, with a penalty given by the "l_0-norm" of the signal's discrete graph gradient. The method proce…

We show that on a two-dimensional compact nontrapping manifold with strictly convex boundary, a piecewise constant function is determined by its integrals over geodesics. In higher dimensions, we obtain a similar result if the manifold satisfies a foliation condition. These theorems are based on iterating a local uniqu…

GraN-GAN normalizes gradients for better GAN performance.

The Heston stochastic volatility model is a standard model for valuing financial derivatives, since it can be calibrated using semi-analytical formulas and captures the most basic structure of the market for financial derivatives with simple structure in time-direction. However, extending the model to the case of time-…

We show injectivity of the geodesic X-ray transform on piecewise constant functions when the transform is weighted by a continuous matrix weight. The manifold is assumed to be compact and nontrapping of any dimension, and in dimension three and higher we assume a foliation condition. We make no assumption regarding con…

Paper learns dictionaries for sparse signal recovery using automatic differentiation.

Study shows how much information can be learned from sparse signals with limited data.

Many problems on signal processing reduce to nonparametric function estimation. We propose a new methodology, piecewise convex fitting (PCF), and give a two-stage adaptive estimate. In the first stage, the number and location of the change points is estimated using strong smoothing. In the second stage, a constrained s…

We show that on a two-dimensional compact nontrapping Riemannian manifold with strictly convex boundary, a piecewise constant function can be recovered from its integrals over geodesics. We adapt the injectivity proof which uses variations through geodesics to recover the function and we improve this result when the ma…

In this paper we develop an approach to conformal geometry of piecewise flat metrics on manifolds. In particular, we formulate the combinatorial Yamabe problem for piecewise flat metrics. In the case of surfaces, we define the combinatorial Yamabe flow on the space of all piecewise flat metrics associated to a triangul…

We study online optimization of smoothed piecewise constant functions over the domain [0, 1). This is motivated by the problem of adaptively picking parameters of learning algorithms as in the recently introduced framework by Gupta and Roughgarden (2016). Majority of the machine learning literature has focused on Lipsc…

Investigates chaotic financial time series with monthly contributions and devaluation.

We consider the change-point detection problem of deciding, based on noisy measurements, whether an unknown signal over a given graph is constant or is instead piecewise constant over two connected induced subgraphs of relatively low cut size. We analyze the corresponding generalized likelihood ratio (GLR) statistics a…

The paper extends a variance gamma model to quadratic functions, reducing arbitrage and computational costs.

Neural network models improve survival analysis with reduced computation time.

We show that if $g$ is a Riemannian metric on a closed piecewise locally symmetric manifold $M$, then the lift of $g$ to the universal cover $\widetilde{M}$ has a discrete isometry group. We also show that the index $[\Isom(\widetilde{M}): π_1(M)]$ is bounded by a constant independent of $g$.

Defines hierarchical clustering axioms for various densities.

The paper proves a theorem for discretizing Gaussian curvature on surfaces.

A piecewise constant curvature manifold is a triangulated manifold that is assigned a geometry by specifying lengths of edges and stipulating that for a chosen background geometry (Euclidean, hyperbolic, or spherical), each simplex has an isometric embedding into the background geometry with the chosen edge lengths. Ad…

New GMM models fit high-dimensional data with fewer parameters.

We prove a Gauss-Bonnet type formula for Riemann-Finsler surfaces of non-constant indicatrix volume and with regular piecewise smooth boundary. We give a Hadamard type theorem for N-parallels of a Landsberg surface.

Piecewise Linear-Quadratic (PLQ) penalties are widely used to develop models in statistical inference, signal processing, and machine learning. Common examples of PLQ penalties include least squares, Huber, Vapnik, 1-norm, and their asymmetric generalizations. Properties of these estimators depend on the choice of pena…

A method identifies abrupt changes in functions with fixed confidence under noisy feedback.

Transformers struggle to approximate smooth functions, relying on piecewise constant approximations.

Given $iid$ observations from an unknown absolute continuous distribution defined on some domain $Ω$, we propose a nonparametric method to learn a piecewise constant function to approximate the underlying probability density function. Our density estimate is a piecewise constant function defined on a binary partition o…

A piecewise flat manifold is a triangulated manifold given a geometry by specifying edge lengths (lengths of 1-simplices) and specifying that all simplices are Euclidean. We consider the variation of angles of piecewise flat manifolds as the geometry varies in a particular way, which we call a conformal variation. This…

XGBoost is often presented as the algorithm that wins every ML competition. Surprisingly, this is true even though predictions are piecewise constant. This might be justified in high dimensional input spaces, but when the number of features is low, a piecewise linear model is likely to perform better. XGBoost was exten…

The paper proposes new cross-correlators using Price's Theorem and piecewise-linear decomposition.

New method uses DC functions for piecewise linear regression.

A new method solves complex financial equations efficiently.

Paper introduces differentiable sorting and ranking with $O(n \log n)$ time complexity.

To measure the quality of a set of vector quantization points a means of measuring the distance between a random point and its quantization is required. Common metrics such as the {\em Hamming} and {\em Euclidean} metrics, while mathematically simple, are inappropriate for comparing natural signals such as speech or im…

We develop a method to learn neural network activations with controlled Lipschitz constant.

Filter banks are a popular tool for the analysis of piecewise smooth signals such as natural images. Motivated by the empirically observed properties of scale and detail coefficients of images in the wavelet domain, we propose a hierarchical deep generative model of piecewise smooth signals that is a recursion across s…

We consider the generic regularized optimization problem $\hat{\mathsfβ}(λ)=\arg \min_βL({\sf{y}},X{\sfβ})+λJ({\sfβ})$. Efron, Hastie, Johnstone and Tibshirani [Ann. Statist. 32 (2004) 407--499] have shown that for the LASSO--that is, if $L$ is squared error loss and $J(β)=\|β\|_1$ is the $\ell_1$ norm of $β$--the opti…

Marchal's lemma is the basic tool for eliminating collisions when using the direct method of the calculus of variations to establish existence of "designer" solutions to the classical N-body problem. Our goal here is to understand why Marchal's lemma holds, by taking a metric geometry perspective and employing the Jaco…

The double tetrahedron is the triangulation of the three-sphere gotten by gluing together two congruent tetrahedra along their boundaries. As a piecewise flat manifold, its geometry is determined by its six edge lengths, giving a notion of a metric on the double tetrahedron. We study notions of Einstein metrics, consta…

We study the theoretical properties of image denoising via total variation penalized least-squares. We define the total vatiation in terms of the two-dimensional total discrete derivative of the image and show that it gives rise to denoised images that are piecewise constant on rectangular sets. We prove that, if the t…

We present a detailed analysis of the class of regression decision tree algorithms which employ a regulized piecewise-linear node-splitting criterion and have regularized linear models at the leaves. From a theoretic standpoint, based on Rademacher complexity framework, we present new high-probability upper bounds for …

Smooth symplectic manifolds can be approximated by PL symplectic manifolds.