Paper develops a consistent model selection framework for learning Hypotheses Space from data.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Paper tackles efficient learning of non-convex hypotheses in metric spaces.
Boosting combines weak hypotheses to create accurate predictions under bounded VC dimension.
DivDis learns diverse hypotheses from underspecified data to improve robustness.
Machine Learning benefits from prior information and computational power for better performance and understanding.
New method uses LLMs to generate detailed scientific hypotheses.
Sequential tests for nonparametric hypotheses using supermartingales.
In many practical applications of multiple hypothesis testing using the False Discovery Rate (FDR), the given hypotheses can be naturally partitioned into groups, and one may not only want to control the number of false discoveries (wrongly rejected null hypotheses), but also the number of falsely discovered groups of …
In this paper, we diagnose deep neural networks for 3D point cloud processing to explore utilities of different intermediate-layer network architectures. We propose a number of hypotheses on the effects of specific intermediate-layer network architectures on the representation capacity of DNNs. In order to prove the hy…
We propose a method to generate multiple diverse and valid human pose hypotheses in 3D all consistent with the 2D detection of joints in a monocular RGB image. We use a novel generative model uniform (unbiased) in the space of anatomically plausible 3D poses. Our model is compositional (produces a pose by combining par…
Hypothesis testing in singular models is fundamentally about identifiable vs. non-identifiable parameters.
The paper uses RL to verify hypotheses, overcoming existing limitations.
There is a significant literature on methods for incorporating knowledge into multiple testing procedures so as to improve their power and precision. Some common forms of prior knowledge include (a) beliefs about which hypotheses are null, modeled by non-uniform prior weights; (b) differing importances of hypotheses, m…
Attention-based encoder decoder network uses a left-to-right beam search algorithm in the inference step. The current beam search expands hypotheses and traverses the expanded hypotheses at the next time step. This traversal is implemented using a for-loop program in general, and it leads to speed down of the recogniti…
s-RBFN integrates multiple hypotheses for efficient and diverse prediction.
It was proved in 1998 by Ben-David and Litman that a concept space has a sample compression scheme of size d if and only if every finite subspace has a sample compression scheme of size d. In the compactness theorem, measurability of the hypotheses of the created sample compression scheme is not guaranteed; at the same…
Near-optimal private tests for simple and MLR hypotheses developed under Gaussian differential privacy.
Current statistical inference problems in areas like astronomy, genomics, and marketing routinely involve the simultaneous testing of thousands -- even millions -- of null hypotheses. For high-dimensional multivariate distributions, these hypotheses may concern a wide range of parameters, with complex and unknown depen…
Confirmation bias leads to biased estimates in noisy data analysis.
The paper proves weaker conditions for global smoothings of special Lagrangian submanifolds with conical singularities.
Study identifies and analyzes spurious correlations in data-driven models.
Boosting algorithms produce a classifier by iteratively combining base hypotheses. It has been observed experimentally that the generalization error keeps improving even after achieving zero training error. One popular explanation attributes this to improvements in margins. A common goal in a long line of research, is …
We consider a distributed learning setup where a network of agents sequentially access realizations of a set of random variables with unknown distributions. The network objective is to find a parametrized distribution that best describes their joint observations in the sense of the Kullback-Leibler divergence. Apart fr…
Crowdsourcing has been successfully applied in many domains including astronomy, cryptography and biology. In order to test its potential for useful application in a Smart Grid context, this paper investigates the extent to which a crowd can contribute predictive hypotheses to a model of residential electric energy con…
Drawing on some recent results that provide the formalism necessary to definite stationarity for infinite random graphs, this paper initiates the study of statistical and learning questions pertaining to these objects. Specifically, a criterion for the existence of a consistent test for complex hypotheses is presented,…
Context. Generative models open up the possibility to interrogate scientific data in a more data-driven way. Aims: We propose a method that uses generative models to explore hypotheses in astrophysics and other areas. We use a neural network to show how we can independently manipulate physical attributes by encoding ob…
New method uses geometric properties for better density estimation.
New framework for valid hypothesis testing in complex data settings.
LLM agents discover cryptocurrency factors under reproducible constraints.
Unified method for MMD variance estimation improves accuracy and computational efficiency.
In this paper, we prove a general halfspace theorem for constant mean curvature surfaces. Under certain hypotheses, we prove that, in an ambient space M^3, any constant mean curvature H_0 surface on one side of a constant mean curvature H_0 surface Σ_0 is an equidistant surface to Σ_0. The main hypotheses of the theore…
The problem of finding itemsets that are statistically significantly enriched in a class of transactions is complicated by the need to correct for multiple hypothesis testing. Pruning untestable hypotheses was recently proposed as a strategy for this task of significant itemset mining. It was shown to lead to greater s…
Torsion and Betti numbers for knots are special cases of more general invariants associated to a finitely generated group G and epimorphism from G to the integers. The sequence of Betti numbers is always periodic; under mild hypotheses, the sequence of torsion numbers satisfies a linear homogeneous recurrence relation …
In this paper, we explore various approaches for semi supervised learning in an end to end automatic speech recognition (ASR) framework. The first step in our approach involves training a seed model on the limited amount of labelled data. Additional unlabelled speech data is employed through a data selection mechanism …
We introduce a notion of algorithmic stability of learning algorithms---that we term \emph{argument stability}---that captures stability of the hypothesis output by the learning algorithm in the normed space of functions from which hypotheses are selected. The main result of the paper bounds the generalization error of…
Bounding the generalization error of learning algorithms has a long history, which yet falls short in explaining various generalization successes including those of deep learning. Two important difficulties are (i) exploiting the dependencies between the hypotheses, (ii) exploiting the dependence between the algorithm'…
New method quantifies reliability of neural network image segmentation.
It is hypothesized that price charts can be empirically decomposed into two components as random and non random. The non random component, which can be treated as approximately regular behavior of the prices (trend) in an epoch, is a geometric line. Thus, the random component fluctuates around the non random component …
New algorithm reduces communication in distributed learning by sharing compressed beliefs.
We information-theoretically reformulate two measures of capacity from statistical learning theory: empirical VC-entropy and empirical Rademacher complexity. We show these capacity measures count the number of hypotheses about a dataset that a learning algorithm falsifies when it finds the classifier in its repertoire …
Finding statistically significant interactions between binary variables is computationally and statistically challenging in high-dimensional settings, due to the combinatorial explosion in the number of hypotheses. Terada et al. recently showed how to elegantly address this multiple testing problem by excluding non-tes…
Paper proposes a new framework for hypothesis testing in imaging.
Do two data samples come from different distributions? Recent studies of this fundamental problem focused on embedding probability distributions into sufficiently rich characteristic Reproducing Kernel Hilbert Spaces (RKHSs), to compare distributions by the distance between their embeddings. We show that Regularized Ma…
Extends knockoff filter for composite null hypotheses in variable selection.
Efficient algorithms identify true hypothesis from many options with minimal actions.
In this paper, we examine previous work on the naive Bayesian classifier and review its limitations, which include a sensitivity to correlated features. We respond to this problem by embedding the naive Bayesian induction scheme within an algorithm that c arries out a greedy search through the space of features. We hyp…
While statistics focusses on hypothesis testing and on estimating (properties of) the true sampling distribution, in machine learning the performance of learning algorithms on future data is the primary issue. In this paper we bridge the gap with a general principle (PHI) that identifies hypotheses with best predictive…
The paper defines and proves the existence of train track maps on graphs of groups.