Automatic differentiation (AD) is an essential primitive for machine learning programming systems. Tangent is a new library that performs AD using source code transformation (SCT) in Python. It takes numeric functions written in a syntactic subset of Python and NumPy as input, and generates new Python functions which c…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,786 papers · 148 categories
Trend · papers per month
48 results for “Python code”
NoMoPy models noise as HMM/FHMM in Python.
problem Modeling noise in data.
method Approximate and exact EM algorithms, cross-validation, confidence region estimation.
result Validated on example problems.
OpenML-Python API simplifies access to OpenML for Python users.
problem Limited access to OpenML for Python users.
method Developed a Python API (OpenML-Python) to integrate OpenML with Python-based tools.
result Facilitates easy access to OpenML's datasets, tasks, and experiments.
EagerPy simplifies writing code for multiple deep learning frameworks.
problem Code duplication and framework lock-in when using different deep learning libraries.
method Integrates multiple frameworks into a single Python framework.
result Automatic compatibility across PyTorch, TensorFlow, JAX, and NumPy.
Python package for fast simulation-based inference.
problem Intractable likelihood functions in Bayesian inference.
method Uses neural networks as surrogate models for Bayesian inference.
result Highly efficient and user-friendly for constructing SBI estimators.
XDeep interprets deep neural networks for practitioners and researchers.
problem Understanding and interpreting deep neural networks.
method Post-hoc interpretation algorithms integrated into XDeep.
result XDeep provides local and global explanations for deep models.
skscope simplifies sparsity-constrained optimization in Python.
problem Tedious mathematical deduction and programming for sparsity-constrained optimization.
method Introduces skscope, a Python library that allows users to solve sparsity-constrained optimization problems by just programming the objective function.
result skscope enables state-of-the-art solvers to quickly attain sparse solutions in high-dimensional spaces, achieving up to 80x speedup.
Python package reduces hubness in high-dimensional data.
problem Hubness in high-dimensional data affects machine learning tasks.
method Hubness analysis, reduction, and approximate neighbor search.
result Improves neighbor retrieval and learning tasks in high dimensions.
Python package for estimating intrinsic dimensionality of datasets.
problem Estimating intrinsic dimensionality for machine learning applications.
method Implementation of various intrinsic dimension estimators in Python.
result Benchmarking of ID estimation methods on real and synthetic data.
PyOD is an open-source Python toolbox for performing scalable outlier detection on multivariate data. Uniquely, it provides access to a wide range of outlier detection algorithms, including established outlier ensembles and more recent neural network-based approaches, under a single, well-documented API designed for us…
Gradient Codingstat.ML
We propose a novel coding theoretic framework for mitigating stragglers in distributed learning. We show how carefully replicating data blocks and coding across gradients can provide tolerance to failures and stragglers for Synchronous Gradient Descent. We implement our schemes in python (using MPI) to run on Amazon EC…
PySAD offers a unified Python framework for efficient streaming anomaly detection.
problem Efficient anomaly detection in streaming data with strict constraints.
method Unified architecture with 17+ streaming algorithms, specialized components, and support for multiple learning paradigms.
result PySAD enables real-time processing with bounded memory and is compatible with other Python frameworks.
The need to efficiently calculate first- and higher-order derivatives of increasingly complex models expressed in Python has stressed or exceeded the capabilities of available tools. In this work, we explore techniques from the field of automatic differentiation (AD) that can give researchers expressive power, performa…
AutoGMM automates Gaussian mixture modeling in Python.
problem Automatic clustering of complex data with uncertainty-aware grouping.
method Strategic initialization using an agglomerative Mahalanobis heuristic, parallelized model selection by information criteria.
result Strong out-of-the-box performance on classic benchmarks and real datasets.
FDApy simplifies analysis of functional data in Python.
problem Analysis of irregularly sampled functional data.
method Implementation of tools for representation, dimension reduction, and dataset generation.
result Efficient analysis of functional data, including irregularly sampled data.
DoubleML is a Python library for causal inference using machine learning.
problem Estimating causal parameters in complex models with machine learning.
method Double machine learning framework for valid statistical inference.
result High flexibility and easy extension for various model specifications.
Python tool for constructing CMC surfaces using DPW method.
problem Constructing minimal and constant mean curvature surfaces.
method DPW method implemented in Python.
result Python package for CMC surfaces in various space forms.
NIMFA is an open-source Python library that provides a unified interface to nonnegative matrix factorization algorithms. It includes implementations of state-of-the-art factorization methods, initialization approaches, and quality scoring. It supports both dense and sparse matrix representation. NIMFA's component-based…
Pykg2vec is an open-source Python library for learning the representations of the entities and relations in knowledge graphs. Pykg2vec's flexible and modular software architecture currently implements 16 state-of-the-art knowledge graph embedding algorithms, and is designed to easily incorporate new algorithms. The goa…
Picasso is a new library for sparse learning problems in R and Python.
problem Sparse learning problems in high-dimensional data analysis.
method Unified framework of pathwise coordinate optimization with efficient active set selection strategies.
result picasso can efficiently handle large-scale problems.
PyHHMM is a Python library for HHMMs with advanced features.
problem Handling heterogeneous observation models and missing data in HMMs.
method Object-oriented Python implementation with advanced features.
result PyHHMM supports a heterogeneous observation model and missing data inference.
Python library for integrating TDA with machine learning.
problem Data exploration and interpretability in machine learning.
method Integrates TDA with scikit-learn API, uses C++ for performance.
result Enhanced data exploration and interpretability in machine learning.
A review of nearest neighbour classifiers, focusing on similarity measures and computational efficiency.
problem Improving the performance of nearest neighbour classifiers.
method Explains mechanisms for assessing similarity (distance), identifying nearest neighbours, and reducing data dimensionality.
result Added new sections on time-series similarity measures, retrieval speed-up, and intrinsic dimensionality.
The abundance of open-source code, coupled with the success of recent advances in deep learning for natural language processing, has given rise to a promising new application of machine learning to source code. In this work, we explore the use of a Siamese recurrent neural network model on Python source code to create …
PHOTONAI simplifies machine learning model development in Python.
problem Rapid and efficient machine learning model development.
method Unified framework combining algorithms from different toolboxes, automating repetitive tasks.
result Achieves state-of-the-art solution in medical machine learning.
Python tool assesses European agricultural production resilience.
problem Estimating resilience of European agricultural production systems.
method Python software to compute annual production resilience indicator.
result Demonstrates resilience of European agricultural production.
ChainerRL is a deep reinforcement learning library for Python.
problem Training and reproducing deep reinforcement learning algorithms.
method Built on Chainer framework, implements various DRL algorithms.
result Fosters reproducible research and replicates benchmark results.
Regression is widely used by practioners across many disciplines. We reformulate the underlying optimisation problem as a second-order conic program providing the flexibility often needed in applications. Using examples from portfolio management and quantitative trading we solve regression problems with and without con…
Python toolbox for causal structure learning from data.
problem Causal structure learning from data.
method Generates data from simulators or real-world datasets, learns causal structure, evaluates graphs, and includes gradient-based methods.
result Convenience and efficiency in causal discovery with GPU acceleration.
Recent work has shown that Field-Programmable Gate Arrays (FPGAs) play an important role in the acceleration of Machine Learning applications. Initial specification of machine learning applications are often done using a high-level Python-oriented framework such as Tensorflow, followed by a manual translation to either…
Understanding Entropy Coding With Asymmetric Numeral Systems (ANS): a Statistician's Perspectivestat.ML
This paper simplifies ANS for statisticians, making it easier to use.
problem Statisticians struggle to understand ANS and its versatility.
method Present ANS from a latent variable model perspective and guide step-by-step implementation.
result Made ANS more accessible for statisticians through a Python implementation and library.
dalex simplifies model exploration and fairness for Python developers.
problem Model black-box nature and risks of discrimination, lack of reproducibility, and data drift.
method Model-agnostic interface for interactive model exploration.
result Enhances model transparency and accountability through interactive explainability and fairness.
UncertaintyPlayground simplifies uncertainty estimation in Python.
problem Uncertainty estimation in supervised learning tasks.
method Sparse and Variational Gaussian Process Regressions for normally distributed outcomes, Mixed Density Networks for mixed distributions.
result Fast and simplified uncertainty estimation through Python library.
HiPart offers an efficient, interactive tool for hierarchical clustering.
problem Efficient and interpretable hierarchical clustering for Big Data.
method Divisive hierarchical clustering algorithms with interactive visualizations.
result High computational efficiency and interpretability in Big Data applications.
Bayesian neural networks tutorial via MCMC in Python.
problem Bayesian inference for parameter estimation and uncertainty quantification in deep learning models.
method MCMC sampling methods to implement Bayesian inference, including advanced proposal distributions.
result Challenges in sampling multi-modal posterior distributions for Bayesian neural networks.
Toolkit simplifies transfer learning for researchers.
problem Making transfer learning accessible to non-experts.
method Wraps 17 models, provides easy-to-use interfaces.
result Simplifies model selection for real-world applications.
BFCR detects anomalies in 1D data efficiently.
problem Anomaly detection in 1D data.
method Braced Fourier Continuation and Regression (BFCR) for efficient anomaly detection.
result BFCR trend lines effectively detect anomalies in 1D data.
PyXAB is a Python library for X-armed bandits and online optimization.
problem Efficiently solving X-armed bandit problems and online blackbox optimization.
method Implementation of 10+ X-armed bandit algorithms and synthetic objectives.
result Evaluation of different algorithms' performance on various synthetic objectives.
ProSper is a python library containing probabilistic algorithms to learn dictionaries. Given a set of data points, the implemented algorithms seek to learn the elementary components that have generated the data. The library widens the scope of dictionary learning approaches beyond implementations of standard approaches…
Seglearn is an open-source python package for machine learning time series or sequences using a sliding window segmentation approach. The implementation provides a flexible pipeline for tackling classification, regression, and forecasting problems with multivariate sequence and contextual data. This package is compatib…
TrueLearn: A Python Library for Personalised Informational Recommendations with (Implicit) Feedbackcs.IR
TrueLearn Python library for personalized educational recommendations.
problem Building educational recommendation systems with humanly-intuitive user representations.
method Online learning Bayesian models and open learner concept.
result Library includes models and representations for user control and interpretability.
The wavelet scattering transform is an invariant signal representation suitable for many signal processing and machine learning applications. We present the Kymatio software package, an easy-to-use, high-performance Python implementation of the scattering transform in 1D, 2D, and 3D that is compatible with modern deep …
Tick is a statistical learning library for Python~3, with a particular emphasis on time-dependent models, such as point processes, and tools for generalized linear models and survival analysis. The core of the library is an optimization module providing model computational classes, solvers and proximal operators for re…
Locally Optimal Block Preconditioned Conjugate Gradient (LOBPCG) is demonstrated to efficiently solve eigenvalue problems for graph Laplacians that appear in spectral clustering. For static graph partitioning, 10-20 iterations of LOBPCG without preconditioning result in ~10x error reduction, enough to achieve 100% corr…
combo library simplifies model combination for various machine learning tasks.
problem Facilitating model combination in machine learning.
method Easy-to-use Python toolkit for aggregating models and scores.
result Unified and consistent way to combine models from multiple libraries.
BPt is a Python library for ML with neuroimaging data.
problem Analyzing large neuroimaging datasets using machine learning.
method Unified framework of ML tools for tabulated and neuroimaging data.
result Unified ML tools for neuroimaging and tabulated data.
This paper develops coding techniques to reduce the running time of distributed learning tasks. It characterizes the fundamental tradeoff to compute gradients (and more generally vector summations) in terms of three parameters: computation load, straggler tolerance and communication cost. It further gives an explicit c…
MRCpy implements minimax risk classifiers with performance guarantees and distribution shift adaptability.
problem Classical risk minimization approaches are not robust to distribution shifts.
method Robust risk minimization approach for minimax risk classifiers.
result MRCs provide performance guarantees and adapt to distribution shifts.