NODEs with explicit time dependence can interpolate and generalize like piecewise-constant estimators.
problem Learning from finite datasets with neural ODEs.
method Control-theoretic perspective applied to semi-autonomous NODEs.
result SA-NODEs can interpolate and satisfy SCC, leading to generalization rates similar to histogram and nearest-neighbor estimators.
Kernel interpolation improved with continuous volume sampling.
problem Approximating functions from RKHS using weighted sums of kernel translates.
method Continuous volume sampling for choosing node locations.
result Proved almost optimal bounds for interpolation and quadrature under VS.
Survey explains Kahler-Einstein metrics construction from interpolation problems.
problem Kahler-Einstein metrics on compact complex manifolds.
method Statistical mechanical construction from interpolation problems.
result Probabilistic construction of Kahler solutions to Einstein's equations.
GNNs outperform NNs in interpolating bandlimited functions on Euclidean cubes.
problem Interpolating bandlimited functions on Euclidean cubes using GNNs vs. NNs.
method Investigates optimal GNN configurations and weights for function interpolation.
result GNNs require fewer weights and samples to interpolate bandlimited functions compared to NNs.
Modern supervised learning techniques, particularly those using deep nets, involve fitting high dimensional labelled data sets with functions containing very large numbers of parameters. Much of this work is empirical. Interesting phenomena have been observed that require theoretical explanations; however the non-conve…
BWFlow improves graph generation by smoothly interpolating graph components.
problem Disjoint modeling of graph nodes and edges leads to irregular and non-smooth probability paths.
method Modeling graphs as MRFs and using optimal transport displacement for a smooth probability path.
result BWFlow achieves better training convergence and efficient sampling in graph generation.
In this paper, a rapid and high accurate numerical method for pricing discrete single and double barrier knock-out call options is presented. According to the well-known Black-Scholes framework, the price of option in each monitoring date could be calculate by computing a recursive integral formula upon the heat equati…
The recently developed bag-of-paths (BoP) framework consists in setting a Gibbs-Boltzmann distribution on all feasible paths of a graph. This probability distribution favors short paths over long ones, with a free parameter (the temperature T) controlling the entropic level of the distribution. This formalism enables…
We introduce a new activation function using Chebyshev-Lagrange polynomials for improved neural network performance.
problem Improving data efficiency and accuracy of neural networks.
method Parameterized piece-wise polynomial activation functions based on Chebyshev nodes and Lagrangian interpolation.
result Significant improvements in model capacity and accuracy, especially in linear extrapolation.
Quantum computing speeds up Bermudan option pricing.
problem Efficient pricing of financial derivatives, especially Bermudan options.
method Quantum amplitude estimation combined with Chebyshev interpolation.
result Quadratic speed-up over classical methods.
A neural network method for financial data nowcasting.
problem Financial data nowcasting, especially with variable grid nodes.
method Neural network architecture for variable grid nodes data.
result Outperforms interpolation benchmarks and outlier detection.
Improved NODEs for long-term time series forecasting.
problem Dealing with complex, multi-frequency data.
method Progressive learning paradigm with curriculum learning.
result Performance improved by over 64%.
Optimal graph classification uses message-passing neural networks.
problem Node classification on sparse graphs with fixed feature dimensions.
method Asymptotic local Bayes optimality, message-passing graph neural networks.
result Optimal message-passing architecture interpolates between MLP and convolution.
Study on learning sparse fixed-structure Gaussian Bayesian networks with near-optimal sample complexity.
problem Learning a fixed-structure Gaussian Bayesian network up to a bounded error in total variation distance.
method Analysis of node-wise least squares regression and introduction of BatchAvgLeastSquares and CauchyEst algorithms.
result BatchAvgLeastSquares and CauchyEstTree have near-optimal sample complexity.
This paper provides a practical method to extract caplet volatilities from quoted data.
problem Extracting caplet volatilities from quoted data is complex and not straightforward.
method The paper presents a constructive algorithm based on criteria and robust outlier detection. It includes direct interpolation, bootstrap methods, and global search methods.
result The paper introduces methods to extract caplet volatilities that are arbitrage-free and consistent with quoted data.
Extends RSP model with net flow and capacity constraints for better network analysis.
problem Improving shortest path models with net flows and capacity constraints.
method Developed net flow RSP model and introduced capacity constraints. Proposed algorithms for computing expected routing costs and solving constrained problems using Lagrangian duality.
result Net flow RSP dissimilarity measure is competitive with state-of-the-art dissimilarities.
Improved HGF networks avoid negative precision errors in volatility updates.
problem Negative posterior precision errors in volatility-coupled nodes of HGF networks.
method Introduced a modified quadratic approximation to variational energy.
result Robust update equations across parameter space that track posterior faithfully.
We consider an adversarial online learning setting where a decision maker can choose an action in every stage of the game. In addition to observing the reward of the chosen action, the decision maker gets side observations on the reward he would have obtained had he chosen some of the other actions. The observation str…
3-layer ReLU networks with Ω(√N) nodes can memorize most datasets.
problem Understanding memorization capacity of ReLU networks.
method Analyzing depth and width requirements for memorization.
result Width Θ(√N) is necessary and sufficient for memorizing N data points.
Algorithm learns graph ARMA processes for missing signal estimation.
problem Missing signal estimation in time-varying graph signals.
method Learning joint time-vertex power spectral density through convex relaxations.
result High accuracy in time-vertex signal estimation.
This work develops a generic framework, called the bag-of-paths (BoP), for link and network data analysis. The central idea is to assign a probability distribution on the set of all paths in a network. More precisely, a Gibbs-Boltzmann distribution is defined over a bag of paths in a network, that is, on a representati…
Local Gradient Descent with local steps converges to the centralized model in the interpolation regime.
problem Understanding the implicit bias of Local Gradient Descent in the interpolation regime.
method Analyzing the implicit bias of Local Gradient Descent for classification tasks with linearly separable data.
result The aggregated global model from Local-GD converges exactly to the centralized model in the interpolation regime.
Sparse RSP routing improves graph exploration and classification.
problem Optimal randomized routing and distance measures on weighted graphs.
method Tsallis divergence regularization for sparse RSP.
result Sparse random walk converges to least-cost graph as temperature decreases.
There have lately been several suggestions for parametrized distances on a graph that generalize the shortest path distance and the commute time or resistance distance. The need for developing such distances has risen from the observation that the above-mentioned common distances in many situations fail to take into ac…
FairDrop improves fairness in graph representation learning by counteracting homophily.
problem Ensuring fairness in graph representation learning, especially in scenarios with protected attributes.
method Proposes a biased edge dropout algorithm (FairDrop) to counteract homophily and improve fairness.
result Successfully improves fairness in all models up to a small or negligible drop in accuracy.
A new machine learning method for spatial regression.
problem Spatial/temporal regression with scattered data and arbitrary dimensions.
method Modified Planar Rotator (MPRS) method, a non-parametric model with distance-dependent interactions.
result MPRS predictions are competitive with standard interpolation methods and superior in handling rough and non-Gaussian data.
We study the community detection and recovery problem in partially-labeled stochastic block models (SBM). We develop a fast linearized message-passing algorithm to reconstruct labels for SBM (with n nodes, k blocks, p,q intra and inter block connectivity) when δ proportion of node labels are revealed. The signa…
This paper shows how forward rate interpolations are equivalent to discount factor interpolations in yield curve construction.
problem The challenge of choosing between different interpolation methods for yield curve construction.
method Demonstrates the equivalence between forward rate interpolations and discount factor interpolations.
result Some popular interpolation methods on forward rates are equivalent to classical interpolation methods on discount factors.
The paper proposes a method for generating uniform interpolations on data manifolds.
problem Generating high-quality interpolations between data samples on complex manifolds.
method Autoencoder network with interpolation network, regularized by a Riemannian metric.
result The method generates interpolations that remain within the manifold's distribution.
Study finds conditions for Legendre curves to be interpolating sesqui-harmonic in Sasakian space forms.
problem Characterizing Legendre curves in Sasakian space forms.
method Analyzes necessary and sufficient conditions for Legendre curves to be interpolating sesqui-harmonic.
result Obtains an example of an interpolating sesqui-harmonic Legendre curve in a Sasakian space form.
New FX option interpolations impact implied volatilities.
problem Different interpolations of FX option quotes lead to varying implied volatilities.
method Analysis of various exact interpolations of broker quotes.
result Different interpolations result in different implied volatilities.
Kernel interpolation is inconsistent for norms with smoothness above a constant.
problem Inconsistency of kernel interpolation in reproducing kernel Hilbert spaces.
method Lower bounds for generalization error in Sobolev norms.
result Kernel interpolation is always inconsistent for norms with smoothness above a constant.
Bayesian interpolants explain neural network inferences concisely.
problem Understanding neural network inferences.
method Adapting Craig interpolants for neural networks.
result Produces precise, understandable explanations.
Near-interpolating models grow norms quickly, affecting generalization.
problem Understanding the trade-off between interpolation and generalization in near-interpolating models.
method Random matrix theory and eigendecay analysis of data covariance matrix.
result Near-interpolating models exhibit rapid norm growth and worse generalization trade-offs.
The paper improves interpolation in generative models by using specific base distributions.
problem Unexpected side effects in linear interpolations of normalizing flows.
method Enforces a specific manifold using Dirichlet and von Mises-Fisher base distributions.
result Superior performance in terms of bits per dimension, FID, and KID scores for interpolation.
Paper presents a unified approach to interpolation and geodesics in latent spaces of generative models.
problem Finding geodesics and interpolating in latent spaces of non-Gaussian densities.
method General approach to interpolation and geodesics in latent space for arbitrary density.
result Maximizing quality measure of an interpolating curve is equivalent to finding geodesic.
Improved sparse-view CT images with deep learning sinogram interpolation.
problem Sparse-view CT images quality improvement with limited projection data.
method Combination of U-Net and residual learning for sinogram interpolation.
result Significantly improved CT image quality (RMSE and SSIM metrics) over standard methods.
Deep neural networks can interpolate any dataset in the overparametrized regime.
problem Interpolating any dataset with deep neural networks in the overparametrized regime.
method Proving universal approximations and interpolating any dataset with deep neural networks, considering specific conditions on activation functions.
result Interpolation of any dataset is possible in the overparametrized regime with deep neural networks.
Interpolation hurts robust generalization even without noise.
problem The challenge of robust generalization in the absence of noise.
method Avoiding interpolation through ridge regularization.
result Ridge regularization improves robust generalization.
Uniform convergence of interpolators proven for Gaussian data.
problem Interpolation learning in high-dimensional linear regression with Gaussian data.
method Generic uniform convergence guarantee in terms of Gaussian width.
result Consistency of interpolators for minimum-norm and near-minimal-norm cases.
Interpolation improves nearest neighbor algorithms' performance.
problem Improving nearest neighbor algorithms' performance.
method Considered a class of interpolated weighting schemes and characterized their asymptotic performances.
result Mild degree of data interpolation strictly improves prediction accuracy and statistical stability.
The paper characterizes vector fields as interpolating sesqui-harmonic maps on Riemannian manifolds.
problem Characterizing vector fields as interpolating sesqui-harmonic maps on Riemannian manifolds.
method Characterization theorem and critical point condition for interpolating sesqui-harmonic vector fields.
result Conditions for vector fields to be interpolating sesqui-harmonic maps on compact manifolds.
SoftKI combines SKI and variational methods for scalable GP regression.
problem Scalable Gaussian Process regression on high-dimensional datasets.
method SoftKI approximates kernel via softmax interpolation from a smaller number of learned points.
result SoftKI is competitive with other approximated GP methods for modest data dimensions.
Proves a new law of robustness for interpolating arbitrary data distributions.
problem Understanding robust interpolation for arbitrary data distributions.
method Proves a Lipschitzness lower bound for robust interpolation.
result Demonstrates a two-fold law of robustness for interpolating functions.
Interpolating estimators in nonparametric regression become suboptimal under adversarial attacks.
problem Adversarial robustness of interpolating estimators in nonparametric regression.
method Investigation of adversarial robustness of interpolating estimators in a nonparametric regression framework.
result Interpolating estimators must be suboptimal even under a subtle future X-attack. Framework for analyzing dynamic topological changes in point clouds using persistent homology and dynamic optimal transport.
problem Analyzing transient structural reorganizations during dynamic phase transitions in time-evolutionary point clouds.
method Hierarchical dynamic evaluation framework driven by topological and hypergraph reconstruction strategy.
result Combining transport-based alignment with multi-scale entropy diagnostics for dynamic topological analysis.
Paper investigates optimal interpolation methods in linear regression.
problem Understanding when interpolating methods generalize well in linear regression.
method Investigates optimal response-linear interpolators using functions linear in the response variable.
result Provides a closed-form expression for the optimal interpolator and shows it can be derived as the limit of gradient descent.
Covariance shrinkage via stochastic interpolation
problem High-dimensional covariance estimation
method Recasting shrinkage as empirical risk minimization
result Reduces statistical risk through scheduling, flow maps, and early stopping