New heuristics improve genetic programming's parent selection for classification problems.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New method selects direct causal parents from large sets of variables.
SCARY dataset generates complex causal scenarios for causality research.
FLOP algorithm speeds up causal structure learning for linear models.
The paper improves evolutionary computation by optimizing selection rates.
DAG-FOCI learns causal relationships without parametric assumptions.
Autonomous agents trained via reinforcement learning present numerous safety concerns: reward hacking, negative side effects, and unsafe exploration, among others. In the context of near-future autonomous agents, operating in environments where humans understand the existing dangers, human involvement in the learning p…
For decomposable score-based structure learning of Bayesian networks, existing approaches first compute a collection of candidate parent sets for each variable and then optimize over this collection by choosing one parent set for each variable without creating directed cycles while maximizing the total score. We target…
Graph Neural Networks learn to mimic strong branching in MILP solvers.
We propose dynamical systems trees (DSTs) as a flexible class of models for describing multiple processes that interact via a hierarchy of aggregating parent chains. DSTs extend Kalman filters, hidden Markov models and nonlinear dynamical systems to an interactive group scenario. Various individual processes interact a…
Bayesian method for causal discovery from unknown general interventions.
CogMol designs novel drug-like molecules for SARS-CoV-2 targets.
We present the mixture-of-parents maximum entropy Markov model (MoP-MEMM), a class of directed graphical models extending MEMMs. The MoP-MEMM allows tractable incorporation of long-range dependencies between nodes by restricting the conditional distribution of each node to be a mixture of distributions given the parent…
A Steiner chain of length k consists of k circles, tangent to two given non-intersecting circles (the parent circles) and tangent to each other in a cyclic pattern. The Steiner porism states that once a chain of k circles exists, there exists a 1-parameter family of such chains with the same parent circles that can be …
New algorithm identifies best intervention without graph knowledge.
Study evolutes of curves with varying smoothness.
New algorithm finds causal parent nodes without graph learning.
A neural collaborative filtering method predicts corn hybrid yield performance.
The study optimizes Gaussian process approximations for finite-rank models.
Estimating causal models from observational data is a crucial task in data analysis. For continuous-valued data, Shimizu et al. have proposed a linear acyclic non-Gaussian model to understand the data generating process, and have shown that their model is identifiable when the number of data is sufficiently large. Howe…
Proposes a new CBO method without known causal graphs.
A novel method for learning DAGs from positive-valued data.
ADDA framework speeds up data augmentation in massive data settings.
The statistically equivalent signature (SES) algorithm is a method for feature selection inspired by the principles of constrained-based learning of Bayesian Networks. Most of the currently available feature-selection methods return only a single subset of features, supposedly the one with the highest predictive power.…
In this paper, we propose a novel unsupervised clustering approach exploiting the hidden information that is indirectly introduced through a pseudo classification objective. Specifically, we randomly assign a pseudo parent-class label to each observation which is then modified by applying the domain specific transforma…
Combines Integrated Gradients and PatternAttribution into PGIG, outperforming alternatives.
The paper proves ML estimators are strongly consistent for identifying edge weights in BAR models.
Efficiently learns linear non-Gaussian DAGs with noisy nodes.
Most of metric learning approaches are dedicated to be applied on data described by feature vectors, with some notable exceptions such as times series, trees or graphs. The objective of this paper is to propose a metric learning algorithm that specifically considers relational data. The proposed approach can take benef…
Recently two search algorithms, A* and breadth-first branch and bound (BFBnB), were developed based on a simple admissible heuristic for learning Bayesian network structures that optimize a scoring function. The heuristic represents a relaxation of the learning problem such that each variable chooses optimal parents in…
Invariant Causal Set Covering Machines avoid spurious associations.
New hybrid RL algorithm outperforms model-free and model-based methods.
Zoetrope Genetic Programming improves symbolic regression performance.
The recent progress on capsule networks by Hinton et al. has generated considerable excitement in the machine learning community. The idea behind a capsule is inspired by a cortical minicolumn in the brain, whereby a vertically organised group of around 100 neurons receive common inputs, have common outputs, are interc…
We propose a linear-time, single-pass, top-down algorithm for multiple testing on directed acyclic graphs (DAGs), where nodes represent hypotheses and edges specify a partial ordering in which hypotheses must be tested. The procedure is guaranteed to reject a sub-DAG with bounded false discovery rate (FDR) while satisf…
New method for causal discovery using peeling algorithms for various data types.
We formalize the notion of a pseudo-ensemble, a (possibly infinite) collection of child models spawned from a parent model by perturbing it according to some noise process. E.g., dropout (Hinton et. al, 2012) in a deep neural network trains a pseudo-ensemble of child subnetworks generated by randomly masking nodes in t…
Research shows franchised fast food companies' stock prices decline more during recessions.
Majority bit estimation in noisy random recursive DAGs.
Many algorithms for score-based Bayesian network structure learning (BNSL), in particular exact ones, take as input a collection of potentially optimal parent sets for each variable in the data. Constructing such collections naively is computationally intensive since the number of parent sets grows exponentially with t…
The paper classifies hyperbolic and satellite T-links formed by twisting.
We present a new approach to learning the structure and parameters of a Bayesian network based on regularized estimation in an exponential family representation. Here we show that, given a fixed variable order, the optimal structure and parameters can be learned efficiently, even without restricting the size of the par…
New method models portfolios with leptokurtic risk factors using Gram-Charlier expansions.
Applied researchers often construct a network from a random sample of nodes in order to infer properties of the parent network. Two of the most widely used sampling schemes are subgraph sampling, where we sample each vertex independently with probability and observe the subgraph induced by the sampled vertices, and…
Two new Hie-TAN and Hie-TAN-Lite algorithms improve TAN for hierarchical feature spaces.
Learning Bayesian networks is often cast as an optimization problem, where the computational task is to find a structure that maximizes a statistically motivated score. By and large, existing learning tools address this optimization problem using standard heuristic search techniques. Since the search space is extremely…
We consider the problem of inferring the directed, causal graph from observational data, assuming no hidden confounders. We take an information theoretic approach, and make three main contributions. First, we show how through algorithmic information theory we can obtain SCI, a highly robust, effective and computational…
Proposes a hierarchical model for learning discrete Bayesian networks with shrinkage.