arXiv research

PyChEst detects changes in non-stationary time series without distributional assumptions.

This paper proposes a novel Gaussian process approach to fault removal in time-series data. Fault removal does not delete the faulty signal data but, instead, massages the fault from the data. We assume that only one fault occurs at any one time and model the signal by two separate non-parametric Gaussian process model…

Study reveals convergence properties of SGD with random learning rate.

This paper studies a class of continuous-time scalar-state stochastic Linear-Quadratic (LQ) optimal control problem with the linear control constraints. Applying the state separation theorem induced from its special structure, we develop the explicit solution for this class of problem. The revealed optimal control poli…

This paper proposes a method to approximate non-Gaussian likelihoods in Gaussian Processes.

Algorithm minimizes control regret for non-stationary LQR systems.

This work focuses on the estimation of multiple change-points in a time-varying Ising model that evolves piece-wise constantly. The aim is to identify both the moments at which significant changes occur in the Ising model, as well as the underlying graph structures. For this purpose, we propose to estimate the neighbor…

Intelligent behaviour in the real-world requires the ability to acquire new knowledge from an ongoing sequence of experiences while preserving and reusing past knowledge. We propose a novel algorithm for unsupervised representation learning from piece-wise stationary visual data: Variational Autoencoder with Shared Emb…

In this paper we analyze the asymptotic properties of l1 penalized maximum likelihood estimation of signals with piece-wise constant mean values and/or variances. The focus is on segmentation of a non-stationary time series with respect to changes in these model parameters. This change point detection and estimation pr…

We study in this paper a class of constrained linear-quadratic (LQ) optimal control problem formulations for the scalar-state stochastic system with multiplicative noise, which has various applications, especially in the financial risk management. The linear constraint on both the control and state variables considered…

In this paper, we investigate a transition from an elastica to a piece-wised elastica whose connected point defines the hinge angle $φ_0$; we refer the piece-wised elastica $Λ_{φ_0}$-elastica or $Λ$-elastica. The transition appears in the bending beam experiment; we compress elastic beams gradually and then suddenly du…

Hidden Markov jump processes are an attractive approach for modeling clinical disease progression data because they are explainable and capable of handling both irregularly sampled and noisy data. Most applications in this context consider time-homogeneous models due to their relative computational simplicity. However,…

New algorithm reduces dynamic regret for noisy gradient feedback with piecewise polynomial comparators.

In this survey article, we review the relation between heat kernels and path integrals. In particular, we review recent results on the approximation of the Wiener measure on compact manifold by measures on (finite-dimensional) spaces of piece-wise geodesics.

A new method for creating simpler models from complex ones.

DAMI uses interpretable regions to select informative samples for deep learning models.

CTR prediction in real-world business is a difficult machine learning problem with large scale nonlinear sparse data. In this paper, we introduce an industrial strength solution with model named Large Scale Piece-wise Linear Model (LS-PLM). We formulate the learning problem with $L_1$ and $L_{2,1}$ regularizers, leadin…

We show how neural models can be used to realize piece-wise constant functions such as decision trees. The proposed architecture, which we call locally constant networks, builds on ReLU networks that are piece-wise linear and hence their associated gradients with respect to the inputs are locally constant. We formally …

This paper extends depth separation results to piece-wise oscillatory functions.

This work simplifies adversarial attacks using neural networks, reducing computation and improving training convergence.

RUMBoost combines RUMs and deep learning for better choice modelling.

Deep neural networks paved the way for significant improvements in image visual categorization during the last years. However, even though the tasks are highly varying, differing in complexity and difficulty, existing solutions mostly build on the same architectural decisions. This also applies to the selection of acti…

Considering Wirtinger's inequality for piece-wise equipartite functions we find a discrete version of this classical inequality. The main tool we use is the theorem of classification of isometries. Our approach provides a new elementary proof of Wirtinger's inequality that also allows to study the case of equality. Mor…

The paper proves Sard's theorem for polynomial maps in infinite dimensions.

Ordinal regression predicts the objects' labels that exhibit a natural ordering, which is important to many managerial problems such as credit scoring and clinical diagnosis. In these problems, the ability to explain how the attributes affect the prediction is critical to users. However, most, if not all, existing ordi…

Method to create rational Seifert surfaces for knots in Lens space.

It is shown that most of the well-known basic results for Sobolev-Slobodeckii and Bessel potential spaces, known to hold on bounded smooth domains in $\mathbb{R}^n$, continue to be valid on a wide class of Riemannian manifolds with singularities and boundary, provided suitable weights, which reflect the nature of the s…

Let S be a triangulated 2-sphere with fixed triangulation T. We apply the methods of thin position from knot theory to obtain a simple version of the three geodesics theorem for the 2-sphere [5]. In general these three geodesics may be unstable, corresponding, for example, to the three equators of an ellipsoid. Using a…

Given two points on a soup can or conical cup with lid, we find and classify all paths of minimal length connecting them. When the number of minimal paths is finite, there are at most four on a can and three on a cup. At worst, minimal paths are piece-wise smooth with three components, each of which is a classical geod…

A new algorithm finds optimal solutions for constrained decision processes.

We investigate the functional determinant of the laplacian on piece-wise flat two-dimensional surfaces, with conical singularities in the interior and/or corners on the boundary. Our results extend earlier investigations of the determinants on smooth surfaces with smooth boundaries. The differences to the smooth case a…

We propose an efficient inference method for switching nonlinear dynamical systems. The key idea is to learn an inference network which can be used as a proposal distribution for the continuous latent variables, while performing exact marginalization of the discrete latent variables. This allows us to use the reparamet…

Method finds differential equations for integrable billiard tables.

Optimal order execution strategies for brokers under reference benchmarks.

Study tackles inverse problems on low-dimensional manifolds, proving stability and proposing a reconstruction algorithm.

In many applications we seek to maximize an expectation with respect to a distribution over discrete variables. Estimating gradients of such objectives with respect to the distribution parameters is a challenging problem. We analyze existing solutions including finite-difference (FD) estimators and continuous relaxatio…

We propose a strategy for approximating Pareto optimal sets based on the global analysis framework proposed by Smale (Dynamical systems, New York, 1973, pp. 531-544). The method highlights and exploits the underlying manifold structure of the Pareto sets, approximating Pareto optima by means of simplicial complexes. Th…

Mode connectivity is a surprising phenomenon in the loss landscape of deep nets. Optima -- at least those discovered by gradient-based optimization -- turn out to be connected by simple paths on which the loss function is almost constant. Often, these paths can be chosen to be piece-wise linear, with as few as two segm…

Most of machine learning approaches have stemmed from the application of minimizing the mean squared distance principle, based on the computationally efficient quadratic optimization methods. However, when faced with high-dimensional and noisy data, the quadratic error functionals demonstrated many weaknesses including…

New methods for calculating curvature in graph theory.

The functional determinant of an elliptic operator with positive, discrete spectrum may be defined as $e^{-Z'(0)}$, where $Z(s)$, the zeta function, is the sum $\sum_n^{\infty} λ_n^{-s}$ analytically continued to $s$ around the origin. In this paper $Z'(0)$ is calculated for the Laplace operator with Dirichlet boundary…

We provide larger step-size restrictions for which gradient descent based algorithms (almost surely) avoid strict saddle points. In particular, consider a twice differentiable (non-convex) objective function whose gradient has Lipschitz constant L and whose Hessian is well-behaved. We prove that the probability of init…

New definition resolves ambiguity in non-stationary bandit classification.

We seek to improve the data efficiency of neural networks and present novel implementations of parameterized piece-wise polynomial activation functions. The parameters are the y-coordinates of n+1 Chebyshev nodes per hidden unit and Lagrangian interpolation between the nodes produces the polynomial on [-1, 1]. We show …

The method approximates stationary distributions of Markov models by truncating irrelevant states.

Proposes a new algorithm for non-stationary bandits.

The paper classifies ruled surfaces in Lorentz-Minkowski space that are stationary for the moment of inertia.

SmoothFBO tackles non-stationary functional bilevel optimization.