Novel method for efficient low-rank matrix estimation and bandit algorithms.
problem Low-rank matrix estimation and bandit problems.
method LowPopArt method for low-rank matrix estimation and novel experimental design criterion.
result Improved recovery guarantees and regret bounds for low-rank bandit algorithms.
The paper improves dialogue quality estimation using a novel user satisfaction model.
problem Improving dialogue quality estimation in spoken dialogue systems.
method Proposes a novel user satisfaction estimator based on BiLSTMs and reinforcement learning.
result The novel user satisfaction estimator outperforms previous models in terms of user satisfaction and task success.
Novel estimator reduces diffusion model variance.
problem High variance in score function estimation for diffusion models.
method Uses nearest neighbour samples to estimate the score function.
result Significant decrease in variance, leading to improved model performance.
A new linear contextual bandit algorithm with improved regret bound.
problem Efficiently solving linear contextual bandit problems with reduced regret.
method Proposes a novel estimator embedded with exploration and a self-normalized bound.
result Regret bound matches lower bound of Ω ( d T ) Ω(\sqrt{dT}) Ω ( d T ) up to logarithmic factors. Develops a novel stochastic algorithm for diagonal estimation of large matrices.
problem Efficient diagonal estimation for large or implicit matrices.
method Adaptive parameter selection in a stochastic algorithm.
result Lower bound on random query vectors needed for estimation.
Novel method improves load estimation in power grids using anomaly and change point detection.
problem Improving load estimation in power grid systems.
method Combining unsupervised anomaly and change point detection methods for automatic filtering.
result Automatic load estimation is accurate with 90% estimates within a 10% error margin.
Paper improves variance control in importance weighted variational bounds.
problem Improving the variance of gradient estimators for IWAE.
method Develops a novel control variate that grows SNR as √K for large K.
result Empirically, the method yields superior variance reduction for generative models.
Natural experiment dataset reveals inconsistent treatment effect estimators.
problem Inconsistent results from over 20 estimators on a new dataset.
method Created a benchmark to evaluate estimator accuracy, derived variance formula, introduced new estimator.
result Doubly robust estimators outperform others by orders of magnitude.
Novel stability bounds for OT maps improve density estimation.
problem Estimating optimal transport maps between probability distributions.
method Developed novel stability bounds for OT maps, reducing the problem to density estimation.
result Stability bounds allow for sharper guarantees without smoothness assumptions.
Novel mean estimation method under user-level differential privacy reduces noise in continual mean estimates.
problem Maintaining accurate running mean estimates under user-level differential privacy.
method Developed a novel mean estimation specific factorization under approximate differential privacy.
result Achieved asymptotically lower mean-squared error bounds in continual mean estimation.
We present a novel procedure for scaling relatively high frequency tail probability and quantile estimates for the conditional distribution of returns.
This paper presents a novel scaling method for unbiased risk estimation.
problem Challenges in risk assessment due to limited data, non-stationarity, and heavy tails.
method Develops a statistical framework for efficient risk scaling, extending beyond the square-root-of-time rule.
result Ensures robust and conservative risk estimation, applicable to small sample settings.
The positivity assumption, or the experimental treatment assignment (ETA) assumption, is important for identifiability in causal inference. Even if the positivity assumption holds, practical violations of this assumption may jeopardize the finite sample performance of the causal estimator. One of the consequences of pr…
Markov chain (MC) algorithms are ubiquitous in machine learning and statistics and many other disciplines. Typically, these algorithms can be formulated as acceptance rejection methods. In this work we present a novel estimator applicable to these methods, dubbed Markov chain importance sampling (MCIS), which efficient…
Paper develops unbiased gradient estimator for continuous-time models.
problem Estimating unbiased gradient of log-likelihood for continuous-time models.
method Doubly randomized scheme with coupled conditional particle filter (CCPF).
result Unbiased gradient estimate facilitates gradient-based algorithms.
DDSME outperforms SME in estimating multimodal distributions.
problem Efficiency of score matching in multimodal distributions.
method Diffusion-based denoising score matching (DDSME) compared to vanilla score matching (SME).
result DDSME avoids the error bound deterioration of SME with increasing mode separation.
This article proposes a novel density estimation based algorithm for carrying out supervised machine learning. The proposed algorithm features O(n) time complexity for generating a classifier, where n is the number of sampling instances in the training dataset. This feature is highly desirable in contemporary applicati…
New method for estimating class proportions in open-set label shift data.
problem Estimating class proportions and distributions when test data includes novel classes.
method Semiparametric density ratio model framework with maximum empirical likelihood estimators and confidence intervals.
result Improved estimation accuracy and classification performance compared to existing methods.
Efficiently estimates models with many variables using minimal communication.
problem Estimating models with a growing number of variables efficiently.
method Two rounds of communication to achieve asymptotically efficient estimator.
result Asymptotically efficient estimator for large-scale distributed data.
Two novel procedures track quantiles efficiently using an oracle.
problem Setting step size and tuning parameters for incremental quantile estimators.
method Estimate MSE, decompose into variance and bias, use oracle to select best estimator.
result Efficient quantile tracking with error close to theoretical optimum.
Proposes a novel neural network method to estimate average treatment effect.
problem Bias in estimating average treatment effect due to confounding and instrumental variables.
method Self-balancing neural network (Sbnet) that estimates pseudo propensity scores and average treatment effect in one step.
result Proposed method outperforms state-of-the-art methods in simulations and real-world datasets.
A novel Bayesian framework for private linear regression with MCMC.
problem Private linear regression in a distributed setting.
method Generative statistical model, MCMC algorithms, fast Bayesian estimation.
result The proposed methods provide well-rounded estimation and prediction.
Existing applications include a huge amount of knowledge that is out of reach for deep neural networks. This paper presents a novel approach for integrating calls to existing applications into deep learning architectures. Using this approach, we estimate each application's functionality with an estimator, which is impl…
Novel estimation methods improve MAR model accuracy for high-dimensional time series.
problem Limited estimation techniques for Matrix Autoregressive (MAR) models.
method Adapted Yule-Walker equations and Burg's method.
result Proposed methods achieve comparable model fit to VAR models.
Novel framework improves GNN uncertainty estimates under distribution shifts.
problem Improving reliability of GNN uncertainty estimates under distribution shifts.
method Adapting stochastic data centering to graph data through novel graph anchoring strategies.
result G- Δ Δ Δ UQ leads to better calibrated GNNs for node and graph classification. Novel method learns memory kernels in Langevin equations.
problem Estimating memory kernels in Langevin equations.
method Regularized Prony method for correlation functions, followed by regression over Sobolev norm-based loss function with RKHS regularization.
result Method outperforms other regression estimators in exponentially weighted L^2 space.
Novel approach for estimating conditional expectations using Bayesian quadrature.
problem Estimating conditional expectations with costly evaluations.
method Probabilistic numerical methods incorporating prior smoothness knowledge.
result Fast convergence rate and uncertainty quantification.
The paper reduces sample complexity for estimating novel task parameters with few meta-learning tasks.
problem Meta-learning sparse linear regression with limited data.
method Accessing multiple similar tasks to recover common support and reduce novel task sample complexity.
result The sample complexity for estimating the parameter of a novel task is greatly reduced to O(1) with respect to the number of tasks.
Develops a new density ratio estimator for causal inference.
problem Estimation of density ratio functions in statistics.
method Super learning approach with a novel loss function.
result Empirical validation of the density ratio super learner's performance.
Paper describes profiles of multivariate normal distributions and novel estimators for mutual information.
problem Estimating mutual information for complex distributions.
method Analytical description of profiles, introduction of Bend and Mix Models, Monte Carlo estimation.
result Bend and Mix Models accurately estimate mutual information profiles and provide Bayesian estimates.
Innovative inequalities for divergences with applications in PAC-Bayesian bounds and Monte Carlo.
problem Developing new inequalities for divergences.
method Introducing novel change of measure inequalities for f f f -divergences and α α α -divergences. result Applications in PAC-Bayesian bounds and Monte Carlo estimates.
Novel approach uses Gaussian processes to estimate conflict trends.
problem Estimating temporal and spatial patterns of violent conflict.
method Highly disaggregated conflict event data with Gaussian processes.
result Powerful conflict forecasts and insights into conflict dynamics.
Novel heat flow estimates on ALE manifolds for Schrödinger operators.
problem Estimating heat flows on ALE manifolds with non-trivial L 2 L^2 L 2 -kernel. method Combining Fredholm theory for Dirac type operators and heat kernel advances.
result Established L p − L q L^p - L^q L p − L q decay estimates for heat flows. Novel method recursively partitions sample space for density estimation.
problem Estimating complex density functions efficiently and accurately.
method Recursive partitioning of the sample space, asymptotically exact.
result Asymptotically exact approximation of any density function.
Paper proposes a novel approach to density ratio estimation using projection pursuit.
problem Density ratio estimation challenges in high dimensions and model misspecification.
method The approach uses projection pursuit to approximate density ratios, addressing high dimensionality and model flexibility issues.
result The proposed estimator is consistent and converges at a certain rate, outperforming existing methods in experiments.
Bayesian method for estimating quantile sets efficiently.
problem Estimating quantile sets of expensive-to-evaluate functions.
method Bayesian active learning with Gaussian process modeling and Expected Estimator Modification (EEM).
result Efficient estimation of small quantile sets.
We study the problem of estimating the mean of a random vector X X X given a sample of N N N independent, identically distributed points. We introduce a new estimator that achieves a purely sub-Gaussian performance under the only condition that the second moment of X X X exists. The estimator is based on a novel concept of a…
Paper proposes a novel method to improve matrix completion with median loss for large datasets.
problem Matrix completion with absolute deviation loss for large-scale data.
method Proposes a refinement step using pseudo data to improve inefficient estimators of median matrix completion.
result Turns inefficient estimators into a rate (near-)optimal matrix completion procedure.
Deep learning models frequently make incorrect predictions with high confidence when presented with test examples that are not well represented in their training dataset. We propose a novel and straightforward approach to estimate prediction uncertainty in a pre-trained neural network model. Our method estimates the tr…
Paper proposes a novel method to estimate differential networks using additional knowledge.
problem Estimating differential statistical dependency networks in high-dimensional data with limited samples.
method Integrates various sources of knowledge beyond data samples to improve differential network estimation.
result Achieves sharp asymptotic convergence rate and improved differential network estimation.
New algorithms minimize regret in multi-task and lifelong linear bandits with shared representation.
problem Minimizing regret in multi-task and lifelong linear bandits with shared representation.
method Novel algorithms using efficient estimator for low-rank linear feature extractor and novel analysis.
result Achieved regret bounds matching minimax lower bound up to logarithmic factors.
Estimates long-term effects of new treatments using historical and short-term data.
problem Estimating long-term effects of novel treatments with limited historical data.
method Surrogate indices, dynamic treatment effect estimation, and double machine learning combined in a unified pipeline.
result Consistent and asymptotically normal estimates of long-term effects under Markovian assumption.
Novel network model estimates mixed-membership structure with covariate information.
problem Estimating latent mixed-membership structure in networks with covariate information.
method Proposes a novel network model that incorporates both community information and node covariate similarities.
result Achieves optimal estimation accuracy for similarity matrix and mixed-membership.
Novel graph theory for neural networks improves understanding of their structure and performance.
problem Understanding the structural benefits and generalization power of neural networks.
method Developed a novel graph theoretical formulation and extended error analysis for neural networks.
result Similar a priori estimates can be obtained for neural networks under certain conditions, independent of input dimension.
Paper introduces a new power-dominance axis in estimator design.
problem Estimator design trade-off between bias and variance.
method Introduces a third power regime, `power-dominant', with an unavoidable error penalty.
result Any estimator in the `power-dominant' regime is structurally sub-optimal.
Novel characterization of augmented balancing weights combining outcome and weighting models.
problem Improving estimation accuracy in machine learning models with balancing weights.
method Characterization of augmented balancing weights as linear models, extending to ridge and lasso regression.
result Equivalence and closed-form expressions for specific model choices, providing insights into performance.
Novel unsupervised random forests improve density estimation and data synthesis.
problem Density estimation and data synthesis for complex tabular data.
method Recursive unsupervised random forests with alternating generation and discrimination rounds.
result Provable consistency and smooth densities with fast execution.
Modes and ridges of the probability density function behind observed data are useful geometric features. Mode-seeking clustering assigns cluster labels by associating data samples with the nearest modes, and estimation of density ridges enables us to find lower-dimensional structures hidden in data. A key technical cha…