P3I learns holistic scene representations from a single image.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Theoretical analysis shows LLMs can self-correct responses through in-context learning.
The paper corrects biases in estimating intrinsic dimension and differential entropy.
Let L be a nonunimodular definite lattice. Using a theorem of Elkies we show that whether L embeds in the standard definite lattice of the same rank is completely determined by a collection of lattice correction terms, one for each metabolizing subgroup of the discriminant group. As a topological application this gives…
New MCMC method corrects bias without extra cost.
This paper improves deep learning model consistency through ensemble methods.
The paper develops methods to assess and correct model uncertainties in graphical models.
PCA whitening weighted by Zipfian word frequencies improves task performance.
Mathematical models are used extensively for diverse tasks including analysis, optimization, and decision making. Frequently, those models are principled but imperfect representations of reality. This is either due to incomplete physical description of the underlying phenomenon (simplified governing equations, defectiv…
New CRB derived for curved models using extrinsic geometry.
Deep ensembles effectively capture epistemic uncertainty through training stochasticity, providing a frequentist perspective.
Sparse subspace clustering (SSC) using greedy-based neighbor selection, such as matching pursuit (MP) and orthogonal matching pursuit (OMP), has been known as a popular computationally-efficient alternative to the conventional L1-minimization based methods. Under deterministic bounded noise corruption, in this paper we…
We present a numerical algorithm for nonnegative matrix factorization (NMF) problems under noisy separability. An NMF problem under separability can be stated as one of finding all vertices of the convex hull of data points. The research interest of this paper is to find the vectors as close to the vertices as possible…
Two approaches improve conformal Bayes for label shift, one post-hoc and one in-training.
Deep reinforcement learning has made significant progress in the field of continuous control, such as physical control and autonomous driving. However, it is challenging for a reinforcement model to learn a policy for each task sequentially due to catastrophic forgetting. Specifically, the model would forget knowledge …
Geometrically refines Cramér-Rao bound using extrinsic manifold curvature.
Study 3d N=1 vacua from M-theory compactification on Spin(7) space.
The paper addresses missing data imputation issues by correcting for distribution shift.
New theory challenges traditional machine learning assumptions.
The separability assumption (Donoho & Stodden, 2003; Arora et al., 2012) turns non-negative matrix factorization (NMF) into a tractable problem. Recently, a new class of provably-correct NMF algorithms have emerged under this assumption. In this paper, we reformulate the separable NMF problem as that of finding the ext…
We study adversarial robustness of neural networks from a margin maximization perspective, where margins are defined as the distances from inputs to a classifier's decision boundary. Our study shows that maximizing margins can be achieved by minimizing the adversarial loss on the decision boundary at the "shortest succ…
Proposes EDM algorithm to accelerate model training in distributed networks.
Geometric framework explains and controls implicit bias in machine learning.
A Bernoulli Mixture Model (BMM) is a finite mixture of random binary vectors with independent dimensions. The problem of clustering BMM data arises in a variety of real-world applications, ranging from population genetics to activity analysis in social networks. In this paper, we analyze the clusterability of BMMs from…
Study on how reparametrization affects neural nets' parameter spaces from a geometric perspective.
Framework improves target domain prediction using quantile matching.
Semantic Web knowledge representation standards, and in particular RDF and OWL, often come endowed with a formal semantics which is considered to be of fundamental importance for the field. Reasoning, i.e., the drawing of logical inferences from knowledge expressed in such standards, is traditionally based on logical d…
Conformal Bayes under label shift: post-hoc calibration vs. in-training adaptation
Conformal prediction improves signal detection accuracy in railway images.
Gradient clipping helps private SGD converge despite potential bias.
Conditional forecasts of risk measures play an important role in internal risk management of financial institutions as well as in regulatory capital calculations. In order to assess forecasting performance of a risk measurement procedure, risk measure forecasts are compared to the realized financial losses over a perio…
This paper shows that pairwise PageRank orders emerge from two-hop walks. The main tool used here refers to a specially designed sign-mirror function and a parameter curve, whose low-order derivative information implies pairwise PageRank orders with high probability. We study the pairwise correct rate by placing the Go…
New method for community detection in graphs faster than DCBM inference.
ProPublica's analysis of recidivism predictions produced by Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) software tool for the task, has shown that the predictions were racially biased against African American defendants. We analyze the COMPAS data using a causal reformulation of the un…
Study investigates how simple speech sounds can form abstract categories.
Semiparametric method removes bias in functional bilevel gradient estimation.
New algorithm radVI improves variational inference by optimizing radial profiles.
In this paper we establish a constructive method in order to show global existence and regularity for a class of degenerate parabolic Cauchy problems which satisfy a weak Hoermander condition on a subset of the domain where the data are measurable and which have regular data on the complementary set of the domain. This…
Generating and eliminating adversarial examples has been an intriguing topic in the field of deep learning. While previous research verified that adversarial attacks are often fragile and can be defended via image-level processing, it remains unclear how high-level features are perturbed by such attacks. We investigate…
The paper explores how LLMs with CoT improve performance on complex tasks.
The paper analyzes DeepWalk and node2vec for community detection in stochastic blockmodels.
Estimates citation impact to recommend best publication venue.
Unified framework for comparing clusterings from information-theoretic and pair-counting perspectives.
In many learning problems, the training and testing data follow different distributions and a particularly common situation is the \textit{covariate shift}. To correct for sampling biases, most approaches, including the popular kernel mean matching (KMM), focus on estimating the importance weights between the two distr…
We describe an exercise of using Big Data to predict the Michigan Consumer Sentiment Index, a widely used indicator of the state of confidence in the US economy. We carry out the exercise from a pure ex ante perspective. We use the methodology of algorithmic text analysis of an archive of brokers' reports over the peri…
A large number of objectives have been proposed to train latent variable generative models. We show that many of them are Lagrangian dual functions of the same primal optimization problem. The primal problem optimizes the mutual information between latent and visible variables, subject to the constraints of accurately …
A novel correction algorithm is proposed for multi-class classification problems with corrupted training data. The algorithm is non-intrusive, in the sense that it post-processes a trained classification model by adding a correction procedure to the model prediction. The correction procedure can be coupled with any app…
Motivated by an important insight from neural science, we propose a new framework for understanding the success of the recently proposed "maxout" networks. The framework is based on encoding information on sparse pathways and recognizing the correct pathway at inference time. Elaborating further on this insight, we pro…