Bayesian framework proves thresholds for multi-graph alignment feasibility.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New study shows limits to classifying brain activity from randomized EEG trials.
The study defines backdoor detection in ML and proves its infeasibility.
Statistical model checking for PCTL on MDPs using reinforcement learning.
DFFL tackles federated learning with heterogeneous objectives and constraints.
Solves a 60-year-old question on agreement measures in statistics.
Stochastic convex optimization problems with expectation constraints (SOECs) are encountered in statistics and machine learning, business, and engineering. In data-rich environments, the SOEC objective and constraints contain expectations defined with respect to large datasets. Therefore, efficient algorithms for solvi…
New method for robust matrix completion with mixed data types.
Contrastive learning simplifies statistical inference for complex models.
We study the fundamental tradeoffs between statistical accuracy and computational tractability in the analysis of high dimensional heterogeneous data. As examples, we study sparse Gaussian mixture model, mixture of sparse linear regressions, and sparse phase retrieval model. For these models, we exploit an oracle-based…
Many problems in statistical learning, imaging, and computer vision involve the optimization of a non-convex objective function with singularities at the boundary of the feasible set. For such challenging instances, we develop a new interior-point technique building on the Hessian-barrier algorithm recently introduced …
Paper explores using hand gestures to type English letters.
This paper presents a unified geometric framework for the statistical analysis of a general ill-posed linear inverse model which includes as special cases noisy compressed sensing, sign vector recovery, trace regression, orthogonal matrix estimation, and noisy matrix completion. We propose computationally feasible conv…
Paper develops inference methods for low-rank tensors without debiasing.
The paper examines the feasibility of managing aggregate cyber-risk in IoT environments.
New method for rigorous confidence intervals in off-policy evaluation.
Automated rock fragmentation assessment using deep learning and spatial statistics.
New bounds for learning near-optimal policies in CMDPs with constraints.
We provide a general theory of the expectation-maximization (EM) algorithm for inferring high dimensional latent variable models. In particular, we make two contributions: (i) For parameter estimation, we propose a novel high dimensional EM algorithm which naturally incorporates sparsity structure into parameter estima…
New algorithm finds best feasible arm in grouped bandits.
To construct interpretable explanations that are consistent with the original ML model, counterfactual examples---showing how the model's output changes with small perturbations to the input---have been proposed. This paper extends the work in counterfactual explanations by addressing the challenge of feasibility of su…
Community detection is a fundamental statistical problem in network data analysis. Many algorithms have been proposed to tackle this problem. Most of these algorithms are not guaranteed to achieve the statistical optimality of the problem, while procedures that achieve information theoretic limits for general parameter…
Bayesian search optimizes exploration of feasible solutions under expensive constraints.
Develops a new framework for integrating satellite allocations in small portfolios.
Commercial activity trackers are set to become an essential tool in health research, due to increasing availability in the general population. The corresponding vast amounts of mostly unlabeled data pose a challenge to statistical modeling approaches. To investigate the feasibility of deep learning approaches for unsup…
Paper introduces a neural network for consistent estimation of optimal transport maps.
In certain situations that shall be undoubtedly more and more common in the Big Data era, the datasets available are so massive that computing statistics over the full sample is hardly feasible, if not unfeasible. A natural approach in this context consists in using survey schemes and substituting the "full data" stati…
The classical multi-set split feasibility problem seeks a point in the intersection of finitely many closed convex domain constraints, whose image under a linear mapping also lies in the intersection of finitely many closed convex range constraints. Split feasibility generalizes important inverse problems including con…
Efficiently learns Ising model parameters with limited statistics.
New approach for distributed learning of Gaussian mixtures.
Enhances OTA FL algorithms by defining inverse feasibility for linear models.
Recently, a general method for analyzing the statistical accuracy of the EM algorithm has been developed and applied to some simple latent variable models [Balakrishnan et al. 2016]. In that method, the basin of attraction for valid initialization is required to be a ball around the truth. Using Stein's Lemma, we exten…
Many engineering problems require identifying feasible domains under implicit constraints. One example is finding acceptable car body styling designs based on constraints like aesthetics and functionality. Current active-learning based methods learn feasible domains for bounded input spaces. However, we usually lack pr…
The paper proposes methods to infer from privacy-protected data using simulation-based techniques.
New algorithm exploits curvature of feasible sets for fast online convex optimization.
Machine learning improves earnings forecasting accuracy and speed.
The paper derives statistics of multi-factor functions from their Fourier transforms.
Multiplicative noise models are often used instead of additive noise models in cases in which the noise variance depends on the state. Furthermore, when Poisson distributions with relatively small counts are approximated with normal distributions, multiplicative noise approximations are straightforward to implement. Th…
An algorithm reduces breast cancer detection data complexity using effect sizes.
Comonotonic allocations are restored under certain constraints, improving risk-sharing.
Motivated by generating personalized recommendations using ordinal (or preference) data, we study the question of learning a mixture of MultiNomial Logit (MNL) model, a parameterized class of distributions over permutations, from partial ordinal or preference data (e.g. pair-wise comparisons). Despite its long standing…
Reinforcement learning can interact with the environment and is suitable for applications in decision control systems. Therefore, we used the reinforcement learning method to establish a foreign exchange transaction, avoiding the long-standing problem of unstable trends in deep learning predictions. In the system desig…
Policy gradient methods in reinforcement learning update policy parameters by taking steps in the direction of an estimated gradient of policy value. In this paper, we consider the statistically efficient estimation of policy gradients from off-policy data, where the estimation is particularly non-trivial. We derive th…
Online social networks (OSN) contain extensive amount of information about the underlying society that is yet to be explored. One of the most feasible technique to fetch information from OSN, crawling through Application Programming Interface (API) requests, poses serious concerns over the the guarantees of the estimat…
The paper analyzes two ISGD modes for statistical inference, deriving error bounds and confidence intervals.
The paper studies SDP feasibility and sos ranks for specific polynomials.
Reinforcement learning is widely used for dialogue policy optimization where the reward function often consists of more than one component, e.g., the dialogue success and the dialogue length. In this work, we propose a structured method for finding a good balance between these components by searching for the optimal re…
This paper simplifies computing higher-order -statistics efficiently.