The theory of automatic groups is developed, including properties and practical algorithms.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Cascading flows improve variational inference in structured programs.
Paper proposes NNAFC for automatic financial factor construction.
Structured weight pruning is a representative model compression technique of DNNs to reduce the storage and computation requirements and accelerate inference. An automatic hyperparameter determination process is necessary due to the large number of flexible hyperparameters. This work proposes AutoCompress, an automatic…
Existing automatic music generation approaches that feature deep learning can be broadly classified into two types: raw audio models and symbolic models. Symbolic models, which train and generate at the note level, are currently the more prevalent approach; these models can capture long-range dependencies of melodic st…
Functional AD for Weil algebra computations.
CoLA automates efficient numerical linear algebra for complex matrix structures.
Learn to automatically plug domain-specific modules into a common network.
Bayesian network structures are usually built using only the data and starting from an empty network or from a naive Bayes structure. Very often, in some domains, like medicine, a prior structure knowledge is already known. This structure can be automatically or manually refined in search for better performance models.…
Neural connectomics has begun producing massive amounts of data, necessitating new analysis methods to discover the biological and computational structure. It has long been assumed that discovering neuron types and their relation to microcircuitry is crucial to understanding neural function. Here we developed a nonpara…
New method speeds up Bayesian optimization in high dimensions.
Exponential growth of stable subgroups in Morse geodesics.
ASVI automates variational inference for complex models.
We discuss a problem posed by Gersten: Is every automatic group which does not contain Z+Z subgroup, hyperbolic? To study this question, we define the notion of "n-tracks of length n", which is a structure like Z+Z, and prove its existence in the non-hyperbolic automatic groups with mild conditions. As an application, …
This paper introduces a spline-based method for nonparametric ADVI that handles complex posterior distributions.
Making sense of a dataset in an automatic and unsupervised fashion is a challenging problem in statistics and AI. Classical approaches for {exploratory data analysis} are usually not flexible enough to deal with the uncertainty inherent to real-world data: they are often restricted to fixed latent interaction models an…
Automates graph convolutional network design for semi-supervised node classification.
Let M be a compact manifold, possibly with boundary. We show that the group of homeomorphisms of M has the automatic continuity property: any homomorphism from Homeo(M) to any separable group is necessarily continuous. This answers a question of C. Rosendal. If N is a submanifold of M, the group of homeomorphisms of M …
We propose a novel algorithm for efficiently computing a sparse directed adjacency matrix from a group of time series following a causal graph process. Our solution is scalable for both dense and sparse graphs and automatically selects the LASSO coefficient to obtain an appropriate number of edges in the adjacency matr…
In this paper, we consider the formal power series whose n-th coefficient is the number of copies of a given finite graph in the ball of radius n centred at the identity element in the Cayley graph of a finitely generated group and call it the growth function. Epstein, Iano-Fletcher and Uri Zwick proved that the growth…
Groups with specific curvature have a regular language of geodesics.
Automating statistical modelling is a challenging problem in artificial intelligence. The Automatic Statistician takes a first step in this direction, by employing a kernel search algorithm with Gaussian Processes (GP) to provide interpretable statistical models for regression problems. However this does not scale due …
The recent proliferation of richly structured probabilistic models raises the question of how to automatically determine an appropriate model for a dataset. We investigate this question for a space of matrix decomposition models which can express a variety of widely used models from unsupervised learning. To enable mod…
In deep learning, performance is strongly affected by the choice of architecture and hyperparameters. While there has been extensive work on automatic hyperparameter optimization for simple spaces, complex spaces such as the space of deep architectures remain largely unexplored. As a result, the choice of architecture …
AxCell automates results extraction from machine learning papers.
This paper proposes an efficient autoHPO method based on data-to-hyper-parameter mapping.
[Context:] Model-based testing is an instrument for automated generation of test cases. It requires identifying requirements in documents, understanding them syntactically and semantically, and then translating them into a test model. One light-weight language for these test models are Cause-Effect-Graphs (CEG) that ca…
A key barrier to making phonetic studies scalable and replicable is the need to rely on subjective, manual annotation. To help meet this challenge, a machine learning algorithm was developed for automatic measurement of a widely used phonetic measure: vowel duration. Manually-annotated data were used to train a model t…
This paper presents the beginnings of an automatic statistician, focusing on regression problems. Our system explores an open-ended space of statistical models to discover a good explanation of a data set, and then produces a detailed report with figures and natural-language text. Our approach treats unknown regression…
Automatically learns flexible symmetry constraints in neural networks using gradients.
While great progress has been made recently in automatic image manipulation, it has been limited to object centric images like faces or structured scene datasets. In this work, we take a step towards general scene-level image editing by developing an automatic interaction-free object removal model. Our model learns to …
We introduce a technique that can automatically tune the parameters of a rule-based computer vision system comprised of thresholds, combinational logic, and time constants. This lets us retain the flexibility and perspicacity of a conventionally structured system while allowing us to perform approximate gradient descen…
Neural machine translation models are used to automatically generate a document from given source code since this can be regarded as a machine translation task. Source code summarization is one of the components for automatic document generation, which generates a summary in natural language from given source code. Thi…
Proposes GTTN for discovering all low-rank structures in deep multi-task learning.
MARS automatically selects tensor decomposition ranks, improving performance in neural network tasks.
New method recovers compressed crack images for automatic segmentation.
In this paper we consider a new approach to studying Kundt spacetimes through -structures. We define a Lie-group such that the -structures satisfying an integrability condition and an existence criterion, which we call Kundt structures, have the property that each metric belonging to the Kundt structure is …
Cone structures over minimal products can't be calibrated smoothly.
This paper provides estimation and inference methods for the best linear predictor (approximation) of a structural function, such as conditional average structural and treatment effects, and structural derivatives, based on modern machine learning (ML) tools. We represent this structural function as a conditional expec…
NARD extends ARD for linear models, promoting sparsity and correlation structure.
Paper uses GNNs to automatically detect botnets from network data.
Geometric AD framework simplifies derivative computation in JAX.
We place an Indian Buffet process (IBP) prior over the structure of a Bayesian Neural Network (BNN), thus allowing the complexity of the BNN to increase and decrease automatically. We further extend this model such that the prior on the structure of each hidden layer is shared globally across all layers, using a Hierar…
A new optimisation framework for neural networks without hyperparameters.
Python package automates causal parameter estimation using Riesz regression.
AdaNet is a lightweight TensorFlow-based (Abadi et al., 2015) framework for automatically learning high-quality ensembles with minimal expert intervention. Our framework is inspired by the AdaNet algorithm (Cortes et al., 2017) which learns the structure of a neural network as an ensemble of subnetworks. We designed it…
ViViT efficiently computes curvature for deep networks without approximations.
New method sparsifies hybrid neural ODEs for better performance and stability.