The center of a quotient group of piecewise linear homeomorphisms is trivial.
problem Understanding the structure of a specific group of homeomorphisms.
method Analyzing a quotient of piecewise linear homeomorphisms of the real line.
result The center of the quotient group is trivial.
This article provides an attempt to extend concepts from the theory of Riemannian manifolds to piecewise linear spaces. In particular we propose an analogue of the Ricci tensor, which we give the name of an Einstein vector field. On a given set of piecewise linear spaces we define and discuss (normalized) Ricci flows. …
Global approximation for piecewise linear paths via signatures.
problem Global approximation theorems for piecewise linear paths.
method Using signatures of piecewise linear paths and their density in Lp-norms. result Linear functionals of signatures are dense in Lp-norms under an integrability condition. PARC uses piecewise linear predictors for regression and classification.
problem Multivariate regression and classification problems.
method Alternates between ridge and softmax regression, and cluster assignment based on accuracy and separability.
result Converges to a local minimum in a finite number of steps.
Investigates stability of piecewise flat Ricci flow using analysis and simulations.
problem Stability of piecewise flat Ricci flow.
method Linear stability analysis and numerical simulations.
result Adaptations avoided numerical instability and led to convergence to smooth solutions.
We prove that every piecewise linear manifold of dimension up to four on which a finite group acts by piecewise linear homeomorphisms admits a compatible smooth structure with respect to which the group acts smoothly. This solves a challenge posed by Thurston in dimension three and confirms a conjecture by Kwasik and L…
Piecewise linear activations create many spurious local minima in neural networks.
problem Understanding the loss surface of neural networks with piecewise linear activations.
method Proved the existence of infinite spurious local minima and partitioned the loss surface into smooth cells.
result Piecewise linear activations create many spurious local minima that are invariant under a continuous path.
Signature uniquely identifies piecewise linear surfaces up to thin homotopy.
problem Characterizing piecewise linear surfaces up to equivalence.
method Crossed module of piecewise linear surfaces and signature homomorphism.
result Signature uniquely characterizes surfaces up to translation and thin homotopy.
The paper extends a variance gamma model to quadratic functions, reducing arbitrage and computational costs.
problem Creating an arbitrage-free interpolation for option pricing models.
method Generalizing the local variance gamma model to a piecewise quadratic local variance function.
result The quadratic model results in an arbitrage-free interpolation of class C3, reducing knots and computational cost.
In this paper, we introduce a bordism category CdPL whose objects are bundles of closed (d−1)-dimensional piecewise linear manifolds and whose morphisms are bundles of d-dimensional piecewise linear cobordisms. In the main theorem of this article, we show that the classifying space $B\mathcal{C}_d^{…
First explicit isometric immersion of a flat Klein bottle in 3D space.
problem Finding an isometric embedding of a Klein bottle in 3D.
method Piecewise-linear map from a Klein bottle to Euclidean 3-space.
result Explicit numerical data for a flat Klein bottle isometrically immersed in 3D.
GraN-GAN normalizes gradients for better GAN performance.
problem Improving image generation in GANs with piecewise linear discriminators.
method Piecewise Gradient Normalization (GraN) for input-dependent normalization.
result Significant performance gains in image generation across various datasets.
Paper proposes variational inference for piecewise-linear systems.
problem Intractability of switching dynamical systems.
method Variational approximation and expectation-maximization algorithms.
result Parameters can be estimated off-line, including the number of linear modes.
New GP model estimates piecewise continuous functions.
problem Piecewise continuous regression functions in scientific and engineering applications.
method Local Gaussian process model with partitioned local data and joint estimation of boundaries.
result Superior performance over conventional GP models in estimating piecewise regression functions.
New method uses DC functions for piecewise linear regression.
problem Regression with piecewise linear constraints.
method Estimates piecewise linear convex functions using a difference of convex functions.
result Method achieves close to minimax statistical risk and comparable performance to existing methods.
Equivariant neural networks use symmetry to interpret complex data.
problem Interpreting and understanding the behavior of equivariant neural networks.
method Decompose layers into simple representations and analyze nonlinear activation functions.
result Equivariant neural networks can be interpreted using a filtration generalizing Fourier series.
A new complexity measure for neural networks improves upon classical methods.
problem Lack of a refined complexity measure for comparing different neural network architectures, especially permutation-invariant ones.
method Introduced an equivalence relation among linear functions and counted them relative to this relation.
result The new complexity measure clearly distinguishes between different models and increases exponentially with depth.
We present a detailed analysis of the class of regression decision tree algorithms which employ a regulized piecewise-linear node-splitting criterion and have regularized linear models at the leaves. From a theoretic standpoint, based on Rademacher complexity framework, we present new high-probability upper bounds for …
Neural networks can represent complex piecewise functions efficiently.
problem Representing continuous piecewise affine functions with neural networks.
method Two hidden layers with ReLU activation, O(p) neurons for p pieces. result CPA functions can be represented by a neural network with linear size.
Paper presents ABGD for efficient piecewise linear regression in high dimensions.
problem Efficiently solving piecewise linear regression in high-dimensional spaces.
method Parametrizes piecewise linear functions as difference of max-affine functions, using ABGD algorithm.
result ABGD converges linearly to an ε-accurate estimate with optimal sample complexity.
We consider smooth isotropic immersions from the 2-dimensional torus into R2n, for n≥2. When n=2 the image of such map is an immersed Lagrangian torus of R4. We prove that such isotropic immersions can be approximated by arbitrarily C0-close piecewise linear isotropic maps. If n≥3 the piece…
New cones in 4D space found with minimal mass.
problem Finding mass-minimizing piecewise linear cones in 4D space.
method Mass minimization via Lipschitz maps, classification of candidates.
result No additional mass-minimizing cones found outside five known cases.
We study algebraic varieties of ReLU networks to understand their representable functions.
problem Understanding the functions that ReLU neural networks can represent.
method We introduce algebraic varieties associated with ReLU networks and derive polynomial equations to characterize representable functions.
result Conditions under which ReLU networks attain their expected dimension, providing insight into their structural properties.
In exchange for large quantities of data and processing power, deep neural networks have yielded models that provide state of the art predication capabilities in many fields. However, a lack of strong guarantees on their behaviour have raised concerns over their use in safety-critical applications. A first step to unde…
Proposes adaptive ridge regression for functional linear models with piecewise shapes.
problem Functional linear regression with unknown coefficient function.
method Adaptive piecewise function template with L2 penalization. result Improves predictive power and interpretability compared to standard methods.
New proof shows efficient ReLU networks for piecewise linear functions.
problem Existence of efficient ReLU neural networks for piecewise linear functions.
method Degree 1 triangulations of the relative homology class bounded by polyhedra.
result Existence of efficient ReLU neural networks for functions with compact support.
The paper tackles prescribing discrete Gaussian curvature on polyhedral surfaces.
problem Prescribing discrete Gaussian curvature on polyhedral surfaces.
method Discrete conformal theory and variational principles with constraints.
result Proves Kazdan-Warner type theorems for polyhedral surfaces.
Hilbert initiated the standpoint in foundations of mathematics. From this standpoint, we allow only a finite number of repetitions of elementary operations when we construct objects and morphisms. When we start from a subset of a Euclidean space. Then we assume that any element of the line has only a finite number of c…
XGBoost is often presented as the algorithm that wins every ML competition. Surprisingly, this is true even though predictions are piecewise constant. This might be justified in high dimensional input spaces, but when the number of features is low, a piecewise linear model is likely to perform better. XGBoost was exten…
A triangulated piecewise-linear minimal surface in Euclidean 3-space defined using a variational characterization is critical for area amongst all continuous piecewise-linear variations with compact support that preserve the simplicial structure. We explicitly construct examples of such surfaces that are embedded and a…
We consider the generic regularized optimization problem β^(λ)=argminβL(y,Xβ)+λJ(β). Efron, Hastie, Johnstone and Tibshirani [Ann. Statist. 32 (2004) 407--499] have shown that for the LASSO--that is, if L is squared error loss and J(β)=∥β∥1 is the ℓ1 norm of β--the opti…
This paper concerns a method of selecting a subset of features for a sequential logit model. Tanaka and Nakagawa (2014) proposed a mixed integer quadratic optimization formulation for solving the problem based on a quadratic approximation of the logistic loss function. However, since there is a significant gap between …
Polytopes in high dimensions have at least 2n+4 normals.
problem Understanding normals to convex polytopes in high dimensions.
method Proved for generic simple polytopes in R^n, n>3.
result Each polytope contains a point with at least 2n+4 normals.
We exhibit a knot P in the solid torus, representing a generator of first homology, such that for any knot K in the 3-sphere, the satellite knot with pattern P and companion K is not smoothly slice in any homology 4-ball. As a consequence, we obtain a knot in a homology 3-sphere that does not bound a piecewise-…
Simplifies PLNNs to interpretable models for better explainability.
problem Challenges in interpretability of PLNNs for high-stakes applications.
method Trained deep network simplification and algorithm for reducing flat networks.
result Improved interpretability of PLNNs without sacrificing performance.
A new definition for vector fields extends the Jacobi set concept.
problem Describing interactions between vector fields on complex domains.
method Piecewise linear approach for simplicial complexes.
result Generalizes Jacobi set concept to vector fields.
We present a new, unifying approach following some recent developments on the complexity of neural networks with piecewise linear activations. We treat neural network layers with piecewise linear activations as tropical polynomials, which generalize polynomials in the so-called (max,+) or tropical algebra, with pos…
Efficiently recovers piecewise linear functions from noisy samples.
problem Recovering a piecewise linear function from noisy samples with unknown segmentation.
method Iterative merging approach for multidimensional segmented regression.
result First sample and computationally efficient algorithm in any fixed dimension.
Algorithm identifies best arm in piecewise stationary linear bandits with minimal samples.
problem Identifying the best arm in a piecewise stationary linear bandit model with unknown contexts and changepoints.
method Design of PSεBAI+ algorithm, consisting of PSεBAI and NεBAI subroutines. result PSεBAI+ achieves optimal sample complexity up to a logarithmic factor. We study piecewise linear co-dimension two embeddings of closed oriented manifolds in Euclidean space, and show that any such embedding can always be isotoped to be a closed braid as long as the ambient dimension is at most five, extending results of Alexander (in ambient dimension three), and Viro and independently Ka…
BART and MOTR-BART improve tree-based predictions with local linear models.
problem Non-linearity and high-order interactions in data.
method Bayesian Additive Regression Trees (BART) and Model Trees BART (MOTR-BART) using piecewise linear functions.
result MOTR-BART achieves equal or better performance with fewer trees than BART.
The image of the branch set of a PL branched cover between PL n-manifolds is a simplicial (n−2)-complex. We demonstrate that the reverse implication also holds: an open and discrete map f:Sn→Sn with the image of the branch set contained in a simplicial (n−2)-complex is equivalent …
Unified piecewise-linear Ricci flows improve community detection.
problem Improving community detection in graph neural networks.
method Proposed piecewise-linear Ricci curvature flows with surgeries.
result Flow consistently outperforms baseline models on real-world datasets.
New algorithm predicts piecewise regular functions online.
problem Online prediction of piecewise regular functions.
method Modified sleeping experts aggregation algorithm.
result Oracle risk bounds for all local regions.
Neural network models improve survival analysis with reduced computation time.
problem Limited expressiveness of standard survival models.
method Piecewise neural network models of hazard and density functions.
result Models outperform state-of-the-art models with less computation time.
Piecewise-linear virtual knots are discussed and classified up to edge index six.
We demonstrate new applications of the trace embedding lemma to the study of piecewise-linear surfaces and the detection of exotic phenomena in dimension four. We provide infinitely many pairs of homeomorphic 4-manifolds W and W′ homotopy equivalent to S2 which have smooth structures distinguished by several for…
SyMPLER improves time series forecasting in nonstationary environments with explainable models.
problem Nonstationary time series forecasting with limited interpretability.
method Dynamic piecewise-linear approximations based on Statistical Learning Theory generalization bounds.
result SyMPLER achieves comparable performance to black-box and explainable models while maintaining interpretability.