Invariant Causal Set Covering Machines avoid spurious associations.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
We improve adversarial robustness calibration analysis for broader hypothesis sets.
Combines TSP and SC to solve real-world vaccine distribution.
The increased affordability of whole genome sequencing has motivated its use for phenotypic studies. We address the problem of learning interpretable models for discrete phenotypes from whole genomes. We propose a general approach that relies on the Set Covering Machine and a k-mer representation of the genomes. We sho…
This paper explains how model invariance improves generalization using data transformations.
Lecture notes on advanced linear regression methods.
The paper debiases machine learning predictions to correct bias in regression coefficients.
Lecture note for data science students on machine learning basics and advanced topics.
We introduce a new algorithm, called CDER, for supervised machine learning that merges the multi-scale geometric properties of Cover Trees with the information-theoretic properties of entropy. CDER applies to a training set of labeled pointclouds embedded in a common Euclidean space. If typical pointclouds correspondin…
Teaches uncertainty in ML through practical examples.
Machine learning aids epidemiologists in analyzing big data.
VR methods improve SGD for faster machine learning.
We introduce a new nearest-prototype classifier, the prototype vector machine (PVM). It arises from a combinatorial optimization problem which we cast as a variant of the set cover problem. We propose two algorithms for approximating its solution. The PVM selects a relatively small number of representative points which…
New CFNN architecture approximates functions with machine accuracy.
Machine learning selects the best prediction rules from noisy data.
Surveying machine learning methods for economic forecasting.
This paper reviews various sampling methods from statistics and machine learning.
New method uses weak labels to create valid confidence sets for predictions.
The goal of confidence-set learning in the binary classification setting is to construct two sets, each with a specific probability guarantee to cover a class. An observation outside the overlap of the two sets is deemed to be from one of the two classes, while the overlap is an ambiguity region which could belong to e…
Inverse reinforcement learning (IRL) infers a reward function from demonstrations, allowing for policy improvement and generalization. However, despite much recent interest in IRL, little work has been done to understand the minimum set of demonstrations needed to teach a specific sequential decision-making task. We fo…
Bayesian framework improves ML classification models' uncertainty estimates.
In this thesis, we draw inspiration from both classical system identification and modern machine learning in order to solve estimation problems for real-world, physical systems. The main approach to estimation and learning adopted is optimization based. Concepts such as regularization will be utilized for encoding of p…
A subset of the sphere is said short if it is contained in an open hemisphere. A short closed set which is geodesically convex is called a cap. The following theorem holds: 1. The minimal number of short closed sets covering the -sphere is . 2. If short closed sets cover the -sphere then (i) their inte…
New covering moves for 3-manifolds up to degree 4.
Gromov-Thurston covers have Betti numbers as expected.
Programming by example is the problem of synthesizing a program from a small set of input / output pairs. Recent works applying machine learning methods to this task show promise, but are typically reliant on generating synthetic examples for training. A particular challenge lies in generating meaningful sets of inputs…
We present a new application and covering number bound for the framework of "Machine Learning with Operational Costs (MLOC)," which is an exploratory form of decision theory. The MLOC framework incorporates knowledge about how a predictive model will be used for a subsequent task, thus combining machine learning with t…
Book introduces ML and AI for causal inference.
In this paper we consider completed coverings that are branched coverings in the sense of Fox. For completed coverings between PL manifolds we give a characterization of the existence of a monodromy representation and the existence of a locally compact monodromy representation. These results stem from a characterizatio…
A new process model for machine learning applications with quality assurance.
Machine and reinforcement learning (RL) are increasingly being applied to plan and control the behavior of autonomous systems interacting with the physical world. Examples include self-driving vehicles, distributed sensor networks, and agile robots. However, when machine learning is to be applied in these new settings,…
Study covers of sphere with homeomorphisms lifting property.
Pen-and-paper exercises cover various machine learning topics.
Artificial intelligence, or AI, enhancements are increasingly shaping our daily lives. Financial decision-making is no exception to this. We introduce the notion of AI Alter Egos, which are shadow robo-investors, and use a unique data set covering brokerage accounts for a large cross-section of investors over a sample …
The recent popularity of deep neural networks (DNNs) has generated a lot of research interest in performing DNN-related computation efficiently. However, the primary focus is usually very narrow and limited to (i) inference -- i.e. how to efficiently execute already trained models and (ii) image classification networks…
The paper studies liftable mapping class groups of cyclic covers of spheres.
The Set Covering Machine (SCM) is a greedy learning algorithm that produces sparse classifiers. We extend the SCM for datasets that contain a huge number of features. The whole genetic material of living organisms is an example of such a case, where the number of feature exceeds 10^7. Three human pathogens were used to…
Estimates open sets for fibrations, leading to volume vanishing results.
Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision. Although many approaches have been proposed, a comprehensive understanding of the achievements and challenges is still lacking…
In this paper we study the homeomorphisms of the disk that are liftable with respect to a simple branched covering. Since any such homeomorphism maps the branch set of the covering onto itself and liftability is invariant up to isotopy fixing the branch set, we are dealing in fact with liftable braids. We prove that th…
A good cover in R^d is a collection of open contractible sets in R^d such that the intersection of any subcollection is either contractible or empty. Motivated by an analogy with convex sets, intersection patterns of good covers were studied intensively. Our main result is that intersection patterns of good covers are …
Makeev proved that among centrally symmetric four-dimensional polytopes, with more than twenty facets and circumscribed about the Euclidean ball of diameter one, there is no universal cover for the family of unit diameter sets. In this paper we examine the converse problem, and prove that each centrally symmetric polyt…
New SGD covering technique yields dimension-independent generalization bounds.
This review covers predictive uncertainty estimation in machine learning.
We prove the long-standing Montesinos conjecture that any closed oriented PL 4-manifold M is a simple covering of S^4 branched over a locally flat surface (cf [J M Montesinos, 4-manifolds, 3-fold covering spaces and ribbons, Trans. Amer. Math. Soc. 245 (1978) 453--467]). In fact, we show how to eliminate all the node s…
Derivatives, mostly in the form of gradients and Hessians, are ubiquitous in machine learning. Automatic differentiation (AD), also called algorithmic differentiation or simply "autodiff", is a family of techniques similar to but more general than backpropagation for efficiently and accurately evaluating derivatives of…
In the present paper we find a bijection between the set of small covers over an -cube and the set of acyclic digraphs with labeled nodes. Using this, we give a formula of the number of small covers over an -cube (generally, a product of simplices) up to Davis-Januszkiewicz equivalence classes and $\mathbf{Z}…
We define a new spectrum for compact length spaces and Riemannian manifolds called the "covering spectrum" which roughly measures the size of the one dimensional holes in the space. More specifically, the covering spectrum is a set of real numbers which identify the distinct covers of the space. We investigat…