arXiv research

Global approximation for piecewise linear paths via signatures.

This paper concerns a method of selecting a subset of features for a sequential logit model. Tanaka and Nakagawa (2014) proposed a mixed integer quadratic optimization formulation for solving the problem based on a quadratic approximation of the logistic loss function. However, since there is a significant gap between …

Efficiently finds sparse solutions to max-plus equations for convex regression.

A hybrid model combines piecewise linear and neural components for interpretable predictions.

Smooth symplectic manifolds can be approximated by PL symplectic manifolds.

Tropical geometry and weighted lattices improve curve and surface fitting.

We consider smooth isotropic immersions from the 2-dimensional torus into $R^{2n}$, for $n \geq 2$. When $n = 2$ the image of such map is an immersed Lagrangian torus of $R^4$. We prove that such isotropic immersions can be approximated by arbitrarily $C^0$-close piecewise linear isotropic maps. If $n \geq 3$ the piece…

Given a piecewise linear (PL) function $p$ defined on an open subset of $\R^n$, one may construct by elementary means a unique polyhedron with multiplicities $\D(p)$ in the cotangent bundle $\R^n\times \R^{n*}$ representing the graph of the differential of $p$. Restricting to dimension 2, we show that any smooth functi…

The paper tackles prescribing discrete Gaussian curvature on polyhedral surfaces.

Improved Gaussian Process model for predicting trajectories without independence assumption errors.

Two new criteria help understand the advantage of deep neural networks.

New method uses DC functions for piecewise linear regression.

We obtain a criterion for approximability by embeddings of piecewise linear maps of a circle to the plane, analogous to the one proved by Minc for maps of a segment to the plane. Theorem. Let S be a triangulation of a circle with s vertices. Let f be a simplicial map of the graph S to the plane. The map f is approximab…

Paper proposes variational inference for piecewise-linear systems.

New applications of trace embedding lemma show exotic 4-manifolds properties.

Paper proposes LANN to measure model complexity of neural networks with curve activation functions.

In this paper we propose and discuss different 0-1 linear models in order to solve the cardinality constrained portfolio problem by using factor models. Factor models are used to build portfolios to track indexes, together with other objectives, also need a smaller number of parameters to estimate than the classical Ma…

Extends Tanimoto kernel to real-valued functions.

Paper introduces $\ell$-DER for regression tasks using morphological operators and convex-concave procedure.

The Immersed Boundary (IB) method is a widely-used numerical methodology for the simulation of fluid-structure interaction problems. The IB method utilizes an Eulerian discretization for the fluid equations of motion while maintaining a Lagrangian representation of structural objects. Operators are defined for transmit…

Label assignment problems with large state spaces are important tasks especially in computer vision. Often the pairwise interaction (or smoothness prior) between labels assigned at adjacent nodes (or pixels) can be described as a function of the label difference. Exact inference in such labeling tasks is still difficul…

The approximation power of general feedforward neural networks with piecewise linear activation functions is investigated. First, lower bounds on the size of a network are established in terms of the approximation error and network depth and width. These bounds improve upon state-of-the-art bounds for certain classes o…

SyMPLER improves time series forecasting in nonstationary environments with explainable models.

The center of a quotient group of piecewise linear homeomorphisms is trivial.

We introduce a nonparametric approach for estimating drift and diffusion functions in systems of stochastic differential equations from observations of the state vector. Gaussian processes are used as flexible models for these functions and estimates are calculated directly from dense data sets using Gaussian process r…

This article provides an attempt to extend concepts from the theory of Riemannian manifolds to piecewise linear spaces. In particular we propose an analogue of the Ricci tensor, which we give the name of an Einstein vector field. On a given set of piecewise linear spaces we define and discuss (normalized) Ricci flows. …

To help understand the underlying mechanisms of neural networks (NNs), several groups have, in recent years, studied the number of linear regions $\ell$ of piecewise linear functions generated by deep neural networks (DNN). In particular, they showed that $\ell$ can grow exponentially with the number of network paramet…

In this contribution we derive an explicit formula for the boundary non-crossing probabilities for Slepian processes associated with the piecewise linear boundary function. This formula is used to develop an approximation formula to the boundary non-crossing probabilities for general continuous boundaries. The formulas…

We prove that every piecewise linear manifold of dimension up to four on which a finite group acts by piecewise linear homeomorphisms admits a compatible smooth structure with respect to which the group acts smoothly. This solves a challenge posed by Thurston in dimension three and confirms a conjecture by Kwasik and L…

Properties of a parametric curve in R^3 are often determined by analysis of its piecewise linear (PL) approximation. For Bezier curves, there are standard algorithms, known as subdivision, that recursively create PL curves that converge to the curve in distance . The exterior angles of PL curves under subdivision are s…

The preservation of ambient isotopic equivalence under piecewise linear (PL) approximation for smooth knots are prominent in molecular modeling and simulation. Sufficient conditions are given regarding: (1) Hausdorff distance, and (2) a sum of total curvature and derivative. High degree Bezier curves are often used as …

Signature uniquely identifies piecewise linear surfaces up to thin homotopy.

PARC uses piecewise linear predictors for regression and classification.

Piecewise linear activations create many spurious local minima in neural networks.

In this paper, we introduce a bordism category $\mathcal{C}_d^{PL}$ whose objects are bundles of closed $(d-1)$-dimensional piecewise linear manifolds and whose morphisms are bundles of $d$-dimensional piecewise linear cobordisms. In the main theorem of this article, we show that the classifying space $B\mathcal{C}_d^{…

Convex regression is a promising area for bridging statistical estimation and deterministic convex optimization. New piecewise linear convex regression methods are fast and scalable, but can have instability when used to approximate constraints or objective functions for optimization. Ensemble methods, like bagging, sm…

The regularization path of the Lasso can be shown to be piecewise linear, making it possible to "follow" and explicitly compute the entire path. We analyze in this paper this popular strategy, and prove that its worst case complexity is exponential in the number of variables. We then oppose this pessimistic result to a…

Paper finds how many neurons are needed to approximate histogram distributions.

Bregman divergences generalize measures such as the squared Euclidean distance and the KL divergence, and arise throughout many areas of machine learning. In this paper, we focus on the problem of approximating an arbitrary Bregman divergence from supervision, and we provide a well-principled approach to analyzing such…

Study approximates nonlinear functionals using deep ReLU networks.

Paper presents ABGD for efficient piecewise linear regression in high dimensions.

New cones in 4D space found with minimal mass.

New proof shows efficient ReLU networks for piecewise linear functions.

Equivariant neural networks use symmetry to interpret complex data.

First explicit isometric immersion of a flat Klein bottle in 3D space.

Hilbert initiated the standpoint in foundations of mathematics. From this standpoint, we allow only a finite number of repetitions of elementary operations when we construct objects and morphisms. When we start from a subset of a Euclidean space. Then we assume that any element of the line has only a finite number of c…

A triangulated piecewise-linear minimal surface in Euclidean 3-space defined using a variational characterization is critical for area amongst all continuous piecewise-linear variations with compact support that preserve the simplicial structure. We explicitly construct examples of such surfaces that are embedded and a…

GroupSort neural networks can approximate Lipschitz continuous functions.