arXiv research

Global approximation for piecewise linear paths via signatures.

This paper concerns a method of selecting a subset of features for a sequential logit model. Tanaka and Nakagawa (2014) proposed a mixed integer quadratic optimization formulation for solving the problem based on a quadratic approximation of the logistic loss function. However, since there is a significant gap between …

Investigates stability of piecewise flat Ricci flow using analysis and simulations.

Smooth symplectic manifolds can be approximated by PL symplectic manifolds.

Efficiently finds sparse solutions to max-plus equations for convex regression.

We consider smooth isotropic immersions from the 2-dimensional torus into $R^{2n}$, for $n \geq 2$. When $n = 2$ the image of such map is an immersed Lagrangian torus of $R^4$. We prove that such isotropic immersions can be approximated by arbitrarily $C^0$-close piecewise linear isotropic maps. If $n \geq 3$ the piece…

New method uses DC functions for piecewise linear regression.

Existing works on "black-box" model interpretation use local-linear approximations to explain the predictions made for each data instance in terms of the importance assigned to the different features for arriving at the prediction. These works provide instancewise explanations and thus give a local view of the model. T…

Paper proposes variational inference for piecewise-linear systems.

Paper proposes LANN to measure model complexity of neural networks with curve activation functions.

Given a piecewise linear (PL) function $p$ defined on an open subset of $\R^n$, one may construct by elementary means a unique polyhedron with multiplicities $\D(p)$ in the cotangent bundle $\R^n\times \R^{n*}$ representing the graph of the differential of $p$. Restricting to dimension 2, we show that any smooth functi…

Two new criteria help understand the advantage of deep neural networks.

The paper tackles prescribing discrete Gaussian curvature on polyhedral surfaces.

Proposes adaptive ridge regression for functional linear models with piecewise shapes.

New GP model estimates piecewise continuous functions.

SURF simplifies distribution estimation with simple, robust, and fast algorithms.

Improved Gaussian Process model for predicting trajectories without independence assumption errors.

Label assignment problems with large state spaces are important tasks especially in computer vision. Often the pairwise interaction (or smoothness prior) between labels assigned at adjacent nodes (or pixels) can be described as a function of the label difference. Exact inference in such labeling tasks is still difficul…

In this paper we propose and discuss different 0-1 linear models in order to solve the cardinality constrained portfolio problem by using factor models. Factor models are used to build portfolios to track indexes, together with other objectives, also need a smaller number of parameters to estimate than the classical Ma…

Paper introduces $\ell$-DER for regression tasks using morphological operators and convex-concave procedure.

We obtain a criterion for approximability by embeddings of piecewise linear maps of a circle to the plane, analogous to the one proved by Minc for maps of a segment to the plane. Theorem. Let S be a triangulation of a circle with s vertices. Let f be a simplicial map of the graph S to the plane. The map f is approximab…

Most existing interpretable methods explain a black-box model in a post-hoc manner, which uses simpler models or data analysis techniques to interpret the predictions after the model is learned. However, they (a) may derive contradictory explanations on the same predictions given different methods and data samples, and…

We demonstrate new applications of the trace embedding lemma to the study of piecewise-linear surfaces and the detection of exotic phenomena in dimension four. We provide infinitely many pairs of homeomorphic 4-manifolds $W$ and $W'$ homotopy equivalent to $S^2$ which have smooth structures distinguished by several for…

SyMPLER improves time series forecasting in nonstationary environments with explainable models.

Piecewise flat approximations for curvature in Euclidean and non-Euclidean spaces.

To help understand the underlying mechanisms of neural networks (NNs), several groups have, in recent years, studied the number of linear regions $\ell$ of piecewise linear functions generated by deep neural networks (DNN). In particular, they showed that $\ell$ can grow exponentially with the number of network paramet…

Deep neural networks with piecewise-polynomial activations can approximate smooth functions and their derivatives.

The center of a quotient group of piecewise linear homeomorphisms is trivial.

Extends Tanimoto kernel to real-valued functions.

Tropical Geometry and Mathematical Morphology share the same max-plus and min-plus semiring arithmetic and matrix algebra. In this chapter we summarize some of their main ideas and common (geometric and algebraic) structure, generalize and extend both of them using weighted lattices and a max-$\star$ algebra with an ar…

This article provides an attempt to extend concepts from the theory of Riemannian manifolds to piecewise linear spaces. In particular we propose an analogue of the Ricci tensor, which we give the name of an Einstein vector field. On a given set of piecewise linear spaces we define and discuss (normalized) Ricci flows. …

PARC uses piecewise linear predictors for regression and classification.

The paper approximates Levi-Civita connection and curvature on 2D manifolds using finite elements.

We consider the numerical approximation of the quantile hedging price in a non-linear market. In a Markovian framework, we propose a numerical method based on a Piecewise Constant Policy Timestepping (PCPT) scheme coupled with a monotone finite difference approximation. We prove the convergence of our algorithm combini…

We prove that every piecewise linear manifold of dimension up to four on which a finite group acts by piecewise linear homeomorphisms admits a compatible smooth structure with respect to which the group acts smoothly. This solves a challenge posed by Thurston in dimension three and confirms a conjecture by Kwasik and L…

The Immersed Boundary (IB) method is a widely-used numerical methodology for the simulation of fluid-structure interaction problems. The IB method utilizes an Eulerian discretization for the fluid equations of motion while maintaining a Lagrangian representation of structural objects. Operators are defined for transmit…

Piecewise linear activations create many spurious local minima in neural networks.

Signature uniquely identifies piecewise linear surfaces up to thin homotopy.

The approximation power of general feedforward neural networks with piecewise linear activation functions is investigated. First, lower bounds on the size of a network are established in terms of the approximation error and network depth and width. These bounds improve upon state-of-the-art bounds for certain classes o…

The paper extends a variance gamma model to quadratic functions, reducing arbitrage and computational costs.

Study approximates nonlinear functionals using deep ReLU networks.

In this paper, we introduce a bordism category $\mathcal{C}_d^{PL}$ whose objects are bundles of closed $(d-1)$-dimensional piecewise linear manifolds and whose morphisms are bundles of $d$-dimensional piecewise linear cobordisms. In the main theorem of this article, we show that the classifying space $B\mathcal{C}_d^{…

First explicit isometric immersion of a flat Klein bottle in 3D space.

The regularization path of the Lasso can be shown to be piecewise linear, making it possible to "follow" and explicitly compute the entire path. We analyze in this paper this popular strategy, and prove that its worst case complexity is exponential in the number of variables. We then oppose this pessimistic result to a…

Exact LAD line fitting via PALB with linear scaling and speed.

GraN-GAN normalizes gradients for better GAN performance.

We study the problem of estimating a manifold from random samples. In particular, we consider piecewise constant and piecewise linear estimators induced by k-means and k-flats, and analyze their performance. We extend previous results for k-means in two separate directions. First, we provide new results for k-means rec…

We introduce a nonparametric approach for estimating drift and diffusion functions in systems of stochastic differential equations from observations of the state vector. Gaussian processes are used as flexible models for these functions and estimates are calculated directly from dense data sets using Gaussian process r…