New neural network models for functional data.
problem Handling non-linear functional data.
method Functional Direct Neural Network (FDNN) and Functional Basis Neural Network (FBNN) with gradient-based optimization.
result Demonstrated effectiveness in complex functional models.
Traditional linear methods for forecasting multivariate time series are not able to satisfactorily model the non-linear dependencies that may exist in non-Gaussian series. We build on the theory of learning vector-valued functions in the reproducing kernel Hilbert space and develop a method for learning prediction func…
The paper generalizes equivariant neural networks on homogeneous spaces to the non-linear setting.
problem Equivariant neural networks on homogeneous spaces.
method Deriving generalized steerability constraints for non-linear equivariant layers.
result The universality of the derived construction for non-linear equivariant layers.
New model for Knightian uncertainty with jumps.
problem Knightian uncertainty and non-linear jumps.
method Probabilistic construction of non-linear affine processes with jumps.
result Tractable model for Knightian uncertainty with sublinear expectations.
New framework for analyzing games with multi-dimensional singular controls and non-linear jumps.
problem Analyzing games with multi-dimensional singular controls and non-linear jump impacts.
method Probabilistic framework with novel class of MFGs (MFGs of parametrisations).
result Existence of equilibria and equivalence with MFGs of singular controls.
Simpler GNNs perform well on graph classification tasks.
problem Understanding what Graph Neural Networks (GNNs) learn and their complexity.
method Dissected GNNs into graph filtering and set function, linearizing them separately.
result Linear graph filtering with non-linear set function is efficient and powerful.
Study reward-free RL in non-linear settings, improving efficiency and removing assumptions.
problem Improving sample efficiency in reward-free reinforcement learning for non-linear function approximation.
method Proposed RFOLIVE algorithm for minimal structural assumptions, analyzed hardness results for reward-free and reward-aware exploration.
result Statistical efficiency and hardness results under various structural assumptions, no need for reachability or explorability assumptions.
The goal of a recommendation system is to predict the interest of a user in a given item by exploiting the existing set of ratings as well as certain user/item features. A standard approach to modeling this problem is Inductive Matrix Completion where the predicted rating is modeled as an inner product of the user and …
The paper provides guarantees for learning switching non-linear systems from a single trajectory.
problem Learning non-linear dynamical systems with switching dynamics.
method Non-asymptotic bounds derived under stability assumptions for i.i.d. switching modes.
result Explicit convergence rates for Hölder and linear function classes based on effective sample size.
We develop algorithms to learn non-linear dynamical systems without mixing assumptions.
problem Learning non-linear dynamical systems from dependent data.
method We introduce an offline algorithm and a one-pass streaming method with SGD-RER.
result Our methods achieve optimal or near-optimal performance for learning non-linear systems.
We provide an overview of several non-linear activation functions in a neural network architecture that have proven successful in many machine learning applications. We conduct an empirical analysis on the effectiveness of using these function on the MNIST classification task, with the aim of clarifying which functions…
Hadwiger's Theorem states that Euclidean-invariant convex-continuous valuations of definable sets are linear combinations of intrinsic volumes. We lift this result from sets to data distributions over sets, specifically, to definable real-valued functions on n-dimensional Euclidean space. This generalizes intrinsic vol…
This work optimizes reservoir computing models by linking recurrence and non-linear dynamics.
problem Understanding how recurrence and non-linear dynamics in cortical networks contribute to their function.
method Transformed time-continuous, recurrent dynamics into an effective feed-forward structure of linear and non-linear temporal kernels.
result Optimal time-series classifiers can be built from random reservoir networks, demonstrating significant performance gains.
The classical multi-set split feasibility problem seeks a point in the intersection of finitely many closed convex domain constraints, whose image under a linear mapping also lies in the intersection of finitely many closed convex range constraints. Split feasibility generalizes important inverse problems including con…
Bayesian optimization improved for biased data.
problem Adversarial bias in observations, especially hidden confounders.
method Reduction to dueling bandits, information-directed sampling (IDS).
result First efficient kernelized algorithm with regret guarantees.
Adaptive NN method improves matrix completion for non-smooth data.
problem Matrix completion with non-smooth non-linear functions under high missingness.
method Two-sided nearest neighbors with \Holder function class non-linearity.
result NN error rate matches oracle's for latent factors, non-trivial for wide range of missingness.
The paper introduces a non-linear version of the process convolution formalism for building covariance functions for multi-output Gaussian processes. The non-linearity is introduced via Volterra series, one series per each output. We provide closed-form expressions for the mean function and the covariance function of t…
New algorithm tackles non-linear utility in MNL bandits with i l d e O ( T ) ilde{O}(\sqrt{T}) i l d e O ( T ) regret.
problem Sequential assortment selection with intricate user-item interactions.
method Upper Confidence Bound principle for non-linear parametric utility functions, including neural networks.
result Achieves i l d e O ( T ) ilde{O}(\sqrt{T}) i l d e O ( T ) regret bound for neural network-based utilities. Optimal algorithms for non-linear ridge bandits reduce burn-in cost.
problem Non-linear models introduce a burn-in period with fixed cost.
method Two-stage algorithm: find initial action, then treat locally linear.
result Two-stage algorithm is statistically optimal.
Enhances Cox model for survival analysis with symbolic non-linear log-risk functions.
problem Limited interpretability and non-linearity in traditional Cox models.
method Introduces GCPH model using Kolmogorov-Arnold Networks for symbolic non-linear log-risk functions.
result GCPH achieves competitive performance and superior interpretability.
The effectiveness of deep neural architectures has been widely supported in terms of both experimental and foundational principles. There is also clear evidence that the activation function (e.g. the rectifier and the LSTM units) plays a crucial role in the complexity of learning. Based on this remark, this paper discu…
We provide a pointwise confidence bound for non-linear least-squares with fixed design.
problem Confidence estimation in non-linear ℓ 2 \ell^2 ℓ 2 -regularized least squares. method Pointwise confidence bound for local minimizers, using weighted norm involving inverse-Hessian.
result The proposed confidence bound scales with the test input's similarity to the training data.
Paper presents a machine learning method to improve significance tests for misspecified linear models.
problem Misspecification of linear assumptions in social science models leads to inaccurate significance levels.
method Apply machine learning to fit ground truth function, calculate linear approximation, and adjust the estimator.
result The method significantly outperforms linear regression for non-linear ground truth functions.
We show how the tangent functor extends from ordinary smooth maps to "microformal morphisms" (also called "thick morphisms") of supermanifolds. Microformal morphisms generalize ordinary maps and correspond to formal canonical relations between the cotangent bundles specified by generating functions depending on positio…
ENIAC method optimizes and explores complex RL problems with non-linear policies.
problem Theoretical understanding of non-linear policies in RL with strategic exploration.
method ENIAC, an actor-critic method for non-linear function approximation.
result ENIAC finds near-optimal policies in polynomial exploration rounds under bounded eluder dimension.
We introduce a new distance metric for non-linear embeddings of Tempered Exponential Measures.
problem Non-linear embeddings of Tempered Exponential Measures (TEMs).
method Parameterization of finite discrete TEMs via Legendre functions, introducing tempered Hilbert co-simplex distance.
result Established a generalization of the Hilbert log cross-ratio simplex distance to a tempered Hilbert co-simplex distance.
Proposes hedging strategies for mortgage prepayment risk.
problem Mortgage prepayment risk and its impact on financial institutions.
method Develops a model incorporating non-linear financial instruments for hedging.
result Shows non-linear risk in prepayment options and validates a functional form of prepayments.
New method for interpreting non-linear models using forward marginal effects.
problem Interpreting non-linear models' feature effects is challenging.
method Introducing forward marginal effects and partitioning feature space for better interpretation.
result Improved interpretation of non-linear prediction functions.
DART optimizes subset selection in non-linear bandit problems.
problem Optimizing subset selection in non-linear bandit problems with correlated rewards.
method DART algorithm for combinatorial bandits without individual arm feedback or linearity assumption.
result DART achieves a regret bound of i l d e O ( K K N T ) ilde{\mathcal{O}}(K\sqrt{KNT}) i l d e O ( K K N T ) . Optimizes non-linear outcomes from summed contributions.
problem Maximizing a non-linear function of summed small contributions.
method Derives a scalable descent algorithm leveraging concentration properties.
result Directly optimizes for stated objective, e.g., A/B test success criterion.
New Shapley values reveal non-linear feature dependencies.
problem Understanding non-linear dependencies in machine learning models.
method Model-independent Shapley values using non-parametric measures of dependence.
result Model-independent Shapley values can uncover non-linear dependencies.
Quantum computing offers a quadratic speedup for estimating non-linear functionals.
problem Estimating non-linear functionals of probability distributions.
method Proposes a quantum-inside-quantum Monte Carlo algorithm for a broad class of non-linear estimation problems.
result Achieves a quadratic speedup for non-linear estimation problems, including nested conditional expectations and stochastic optimization.
Study Nash equilibrium in non-zero-sum game with Bermudan strategies.
problem Optimizing pay-offs in non-linear non-zero-sum games.
method Recursive construction to find Nash equilibrium.
result Existence of Nash equilibrium in non-zero-sum game.
New method for learning causal relationships in PNL models.
problem Learning causal relationships from empirical observations in PNL models.
method Rank-based methods to estimate non-linear functions, disentangling from independence tests.
result Consistent method for PNL causal discovery, validated in experiments.
Study contextual bandits with stage-wise constraints, proving regret bounds and extending results.
problem Contextual bandits with stage-wise constraints in high probability and expectation settings.
method Upper-confidence bound algorithms for linear and non-linear reward/cost functions, extending to multiple constraints.
result Regret bounds for various settings, including non-linear reward/cost functions.
New neural network models for complex functional data analysis.
problem Complex relations between functional predictors and responses.
method Function-on-Function regression models using neural networks with continuous hidden layers.
result Demonstrated power and flexibility in handling complex functional models.
Paper proposes a bias-constrained deep learning approach to non-linear estimation.
problem Designing unbiased estimators for non-linear models.
method Bias Constrained Estimator (BCE) using deep learning with bias constraints.
result Asymptotic MVUEs with Cramer Rao bound performance.
Study p p p -parabolicity on graphs using various energy functionals.
problem Characterize p p p -parabolicity on infinite locally summable graphs. method Analyze p p p -energy functionals and use approximation by finite graphs. result Prove various characterizations of p p p -parabolicity. Develops a data-driven smoothing technique for high-dimensional, non-linear panel data.
problem Improving prediction accuracy in high-dimensional, non-linear panel data models.
method Adaptive discrete smoothing with data-driven weights based on individual function similarity.
result Significant improvement in prediction accuracy compared to traditional linear panel data estimators.
In that paper, we provide a new characterization of the solutions of specific reflected backward stochastic differential equations (or RBSDEs) whose driver g g g is convex and has quadratic growth in its second variable: this is done by introducing the extended notion of g g g -Snell enveloppe. Then, in a second step, we re…
Study non-linear combinatorial bandits with polynomial rewards, finding significant differences from linear cases.
problem Adversarial combinatorial bandits with general non-linear reward functions.
method Extending existing work on adversarial linear combinatorial bandits, analyzing minimax optimal regret for polynomial and non-polynomial reward functions.
result Minimax optimal regret bounds for adversarial combinatorial bandits with general non-linear reward functions.
Improved regret bound for multinomial logistic bandits with non-linearity.
problem Maximizing rewards in multinomial logistic bandits with non-linear feedback.
method Extended the definition of κ ∗ κ_* κ ∗ to multinomial setting and proposed an efficient algorithm. result Minimax-optimal regret bound of O ~ ( R d K T / κ ∗ ) \smash{\widetilde{\mathcal{O}}( R d \sqrt{ {KT}/{κ_*}} ) } O ( R d K T / κ ∗ ) , improving over existing guarantees. In recent work on both generative and discriminative score to log-likelihood-ratio calibration, it was shown that linear transforms give good accuracy only for a limited range of operating points. Moreover, these methods required tailoring of the calibration training objective functions in order to target the desired r…
C-ADAM is a new adaptive solver for complex nested problems.
problem Solving compositional problems involving nested expected values.
method Adaptive solver for non-linear functional nesting of expected values.
result C-ADAM converges to a stationary point in O ( δ − 2.25 ) O(δ^{-2.25}) O ( δ − 2.25 ) . Agents learn state ambiguity from non-linear sensor data using Gaussian approximations.
problem Learning state representation from non-linear sensor data.
method Second-order Taylor approximation of Gaussian distribution for non-linear measurement functions.
result Induces a preference for states based on inferability from observations.
Estimates signals from a continuous dictionary with sparse mixtures using optimization.
problem Estimating signals from a continuous dictionary with unknown mixtures and noise.
method Formulates a regularized optimization problem with data fidelity and ( ℓ 1 , L p ) (\ell_1,L^p) ( ℓ 1 , L p ) -penalty. result High probability bounds on prediction error for the Group-Nonlinear-Lasso solution.
Diffusion Maps improves on Functional PCA for non-linear functional data.
problem Functional PCA's linear manifold assumption fails for non-linear functional data.
method Extends Diffusion Maps to functional data and compares it to Functional PCA.
result Diffusion Maps outperforms Functional PCA in non-linear functional data analysis.
This paper conditions non-linear infinite-dimensional diffusion processes.
problem Conditioning non-linear and infinite-dimensional diffusion processes.
method Infinite-dimensional Girsanov's theorem to condition function-valued stochastic processes.
result Conditioning of non-linear infinite-dimensional diffusion processes is achieved.