Proposes method for eliciting non-parametric joint priors using normalizing flows.
problem Learning complex non-parametric joint priors for model parameters.
method Expert elicitation combined with normalizing flows for generative modeling.
result Framework supports elicitation of both parametric and non-parametric priors.
Parametric t-SNE improves generalization for streaming data.
problem Training neural networks for t-SNE objective function fails due to gradient exploding.
method Applied gradient clipping to solve gradient exploding problem.
result Parametric t-SNE achieves quality compatible with non-parametric t-SNE while generalizing to new data.
Polynomially parametrize interesting knotted surfaces.
problem Constructing polynomial parametrizations of knotted surfaces.
method Develop polynomial parametrization methods for specific knotted surfaces.
result Examples of polynomial parametrizations for knotted spheres, tori, and planes.
Proposes a flexible framework for implied volatility surfaces with random parameters.
problem Inconsistent calibration of parametric implied volatility models when market volatility deviates from the model's regime.
method Introduces random coefficients for parametric implied volatility formulas, preserving analytic flexibility and efficiency.
result Demonstrates improved modeling of implied volatility curves, especially for short-term options and earnings announcements.
This study examines when non-parametric methods are robust to adversarial examples.
problem Understanding when non-parametric methods are robust to adversarial examples.
method Examined general non-parametric methods and established conditions for r-consistency.
result Non-parametric methods like nearest neighbors and kernel classifiers are r-consistent when data is well-separated, while histograms are not.
Representation costs in data science: Unifying function-space views of parametric methods
problem Analyzing representation costs of parametric data-fitting methods
method Developing a general framework for analyzing representation costs through parameter-space regularizers
result Proving that many natural results hold in this abstract setting, including representer theorems for parametric methods on their native spaces
Cookbook transforms constrained statistical inference into unconstrained problems.
problem Transforming constrained statistical inference into unconstrained problems.
method Bijective and diffeomorphisms parametrizations.
result Maintains statistical inference properties like identifiability.
Paper solves recovery of parametrizations from Legendre data.
problem Recovering parametrizations from Legendre data.
method Systematic and widely-applicable method to recover parametrizations from Gauss mapping and height function.
result Showed how to recover parametrization from dense subset of real-analytic parametrizations.
Proposes a parametric t-SNE without perplexity tuning.
problem Non-parametric t-SNE's perplexity parameter limits DR quality.
method Multi-scale parametric t-SNE with deep neural network.
result Produces reliable embeddings with competitive neighborhood preservation.
New method for decomposing high-dimensional parametric domains using PCA and inverse projection.
problem Decomposing high-dimensional parametric domains efficiently.
method Iterative Principal Component Analysis (PCA) and inverse projection methods.
result The proposed method effectively reconstructs the original domain from lower-dimensional data.
Proposes extensions to semi-parametric models using BART for shared covariates.
problem Avoiding poor coverage properties and reducing bias in linear predictor estimates.
method Modifies tree-generation moves in BART to handle shared covariates between linear and non-parametric components.
result Competitive performance in modelling complex interactions and predicting student achievements.
New method improves Bayesian inference for parametric models, robust to misspecification.
problem Inference can be untrustworthy when parametric models are wrong.
method Adaptive nonparametric corrections for parametric Bayesian models using generalized Bayes.
result The method achieves robustness and efficiency, converging fast when the parametric model is close to true.
Parametric generative deep models are state-of-the-art for photo and non-photo realistic image stylization. However, learning complicated image representations requires compute-intense models parametrized by a huge number of weights, which in turn requires large datasets to make learning successful. Non-parametric exem…
X-TFC solves parametric DEs with neural networks and physics constraints.
problem Solving parametric differential equations with physics constraints.
method Combines Theory of Functional Connections and Physics-Informed Neural Networks with a single-layer Extreme Learning Machine.
result Achieves high accuracy with low computational time.
In this paper, we suggest a framework to make use of mutual information as a regularization criterion to train Auto-Encoders (AEs). In the proposed framework, AEs are regularized by minimization of the mutual information between input and encoding variables of AEs during the training phase. In order to estimate the ent…
New method to parametrize infinite Riemann surfaces with bounded triangulations.
problem Parametrizing infinite Riemann surfaces with bounded triangulations.
method Introducing bounded ideal triangulations and proving real-analyticity of the parametrization.
result Real-analytic parametrization of Teichmüller spaces for infinite surfaces with bounded triangulations.
We propose a method for learning Markov network structures for continuous data without invoking any assumptions about the distribution of the variables. The method makes use of previous work on a non-parametric estimator for mutual information which is used to create a non-parametric test for multivariate conditional i…
Deep learning techniques are increasingly being considered for geological applications where -- much like in computer vision -- the challenges are characterized by high-dimensional spatial data dominated by multipoint statistics. In particular, a novel technique called generative adversarial networks has been recently …
This paper presents a semi-parametric algorithm for online learning of a robot inverse dynamics model. It combines the strength of the parametric and non-parametric modeling. The former exploits the rigid body dynamics equa- tion, while the latter exploits a suitable kernel function. We provide an extensive comparison …
Non-parametric time series forecasting without assuming a specific distribution.
problem Time series forecasting with numerical stability issues in classical models.
method Generates predictions by sampling from the empirical distribution of time series data.
result The proposed method produces reasonable forecasts without numerical stability issues.
Physical modeling of robotic system behavior is the foundation for controlling many robotic mechanisms to a satisfactory degree. Mechanisms are also typically designed in a way that good model accuracy can be achieved with relatively simple models and model identification strategies. If the modeling accuracy using phys…
The paper reviews methods for estimating individual treatment effects using non-parametric regression models.
problem Estimating heterogeneous treatment effects in observational data.
method Non-parametric regression models to estimate individual treatment effects.
result A review and development of existing state-of-the-art frameworks for individual treatment effects estimation.
We introduce a novel approach to perform first-order optimization with orthogonal and unitary constraints. This approach is based on a parametrization stemming from Lie group theory through the exponential map. The parametrization transforms the constrained optimization problem into an unconstrained one over a Euclidea…
ParPIC clusters directed graphs using random walks and diffusion operators.
problem Challenges in vertex-level clustering for directed graphs due to edge directionality.
method Parametrized Power-Iteration Clustering (ParPIC) based on reversible random walks and diffusion operators.
result ParPIC achieves competitive clustering accuracy with improved scalability compared to spectral and teleportation-based methods.
A novel MCMC method clusters data faster and more accurately.
problem Efficiently clustering large datasets with unknown number of clusters.
method Master/Worker architecture for distributed MCMC inference.
result Significant improvement in clustering accuracy and speed.
New framework discovers PDEs from sparse, noisy data.
problem Discovering PDEs from sparse and noisy data.
method Combines neural network, genetic algorithm, and adaptive methods.
result Robust to sparse and noisy data, discovers parametric PDEs.
iCOS method estimates risk-neutral densities and option prices without model assumptions.
problem Estimating risk-neutral densities and option prices without model assumptions.
method Leverages Fourier-cosine technique using option-implied cosine series coefficients, without model assumptions.
result Effective in extracting information from option prices under various market conditions.
Unified analysis for nonlinear parametric models in Bayesian optimization.
problem Limited theoretical guarantees for nonlinear parametric models in Bayesian optimization.
method Kernel-based framework for analyzing regularized nonlinear parametric models trained on adaptively collected data.
result Unified convergence guarantees for nonlinear acquisition and surrogate models.
High dimensional sparse learning has imposed a great computational challenge to large scale data analysis. In this paper, we are interested in a broad class of sparse learning approaches formulated as linear programs parametrized by a {\em regularization factor}, and solve them by the parametric simplex method (PSM). O…
New algorithm learns nonlinear phenomena from noisy local measurements without data exchange.
problem Learning nonlinear phenomena from noisy local measurements in a decentralized network.
method Non-parametric learning algorithm that spreads information only between neighboring nodes.
result Non-asymptotic estimation error bounds for the proposed method.
Large over-parametrized models learned via stochastic gradient descent (SGD) methods have become a key element in modern machine learning. Although SGD methods are very effective in practice, most theoretical analyses of SGD suggest slower convergence than what is empirically observed. In our recent work [8] we analyze…
Large deviations theory applied to policy gradient methods.
problem Understanding convergence of policy gradient methods in reinforcement learning.
method Large deviation rate function and contraction principle from large deviations theory.
result Convergence properties of policy gradient methods can be extended to various policy parametrizations.
We introduce a balloon estimator in a generalized expectation-maximization method for estimating all parameters of a Gaussian mixture model given one data sample per mixture component. Instead of limiting explicitly the model size, this regularization strategy yields low-complexity sparse models where the number of eff…
We investigate artificial neural networks as a parametrization tool for stochastic inputs in numerical simulations. We address parametrization from the point of view of emulating the data generating process, instead of explicitly constructing a parametric form to preserve predefined statistics of the data. This is done…
The article applies Lusternik-Schnirelmann theory to establish lower bounds on critical points using sequential and parametrized topological complexity.
problem Establishing lower bounds on the number of critical points of functions using topological complexity.
method Applying Lusternik-Schnirelmann theory to sequential and parametrized topological complexity.
result Established various lower bounds on the number of critical points using sequential and parametrized topological complexity.
Non-parametric bootstrap improves robust portfolio and trading strategy optimization.
problem Mitigating uncertainty in expected returns and covariances in financial decision-making.
method Non-parametric bootstrap framework for robust optimization without distributional assumptions.
result Improved out-of-sample performance with smoother, more stable results.
Adversarially robust machine learning has received much recent attention. However, prior attacks and defenses for non-parametric classifiers have been developed in an ad-hoc or classifier-specific basis. In this work, we take a holistic look at adversarial examples for non-parametric classifiers, including nearest neig…
New method minimizes robust density power-based divergences for general parametric densities.
problem Computational complexity of minimizing DPD for general parametric densities.
method Stochastic approach to minimize DPD for general parametric density models.
result Proposed method can be applied to minimize other density power-based γ-divergences.
One of the main challenges in the parametrization of geological models is the ability to capture complex geological structures often observed in the subsurface. In recent years, generative adversarial networks (GAN) were proposed as an efficient method for the generation and parametrization of complex data, showing sta…
Semi-parametric survival analysis methods like the Cox Proportional Hazards (CPH) regression (Cox, 1972) are a popular approach for survival analysis. These methods involve fitting of the log-proportional hazard as a function of the covariates and are convenient as they do not require estimation of the baseline hazard …
We introduce a technique based on the singular vector canonical correlation analysis (SVCCA) for measuring the generality of neural network layers across a continuously-parametrized set of tasks. We illustrate this method by studying generality in neural networks trained to solve parametrized boundary value problems ba…
A new parametric method studies Willmore flows and energy quantization.
problem Understanding Willmore flows and their singularities.
method Parametric approach to Willmore gradient flows.
result For small-energy weak immersions, a unique solution exists.
Paper develops a method to predict cancer patient survival using molecular profiles.
problem Accurately predicting cancer patient survival with complex survival-molecular profile relationships.
method Kernel Cox partially linear regression with a novel regularized garrotized kernel machine (RegGKM) method.
result The proposed method outperforms other methods in predicting survival accuracy.
Financial econometrics has become an increasingly popular research field. In this paper we review a few parametric and nonparametric models and methods used in this area. After introducing several widely used continuous-time and discrete-time models, we study in detail dependence structures of discrete samples, includi…
Proposes a non-parametric method for deep discrete latent variable models.
problem Learning sparse discrete latent representations in deep models.
method Iterative algorithm with Beta-Bernoulli process prior and local data scaling.
result Improves sparsity and scalability of deep discrete latent variable models.
Paper introduces an online method for estimating the difference between two probability distributions.
problem Estimating the difference between two probability density functions using available data.
method Non-parametric online likelihood-ratio estimation using Pearson-divergence functional minimization.
result The proposed method provides efficient online updates and theoretical guarantees for performance.
Efficient deep neural network (DNN) inference on mobile or embedded devices typically involves quantization of the network parameters and activations. In particular, mixed precision networks achieve better performance than networks with homogeneous bitwidth for the same size constraint. Since choosing the optimal bitwi…
NPOD algorithm improves efficiency in estimating pharmacokinetic parameters.
problem Efficiently estimating joint distribution of model parameters in population pharmacokinetics.
method Uses gradient approach to suggest new support points, reducing evaluation time.
result Achieves similar solutions to NPAG but with significantly fewer cycles and runtime.