The recently introduced Tsetlin Machine (TM) has provided competitive pattern classification accuracy in several benchmarks, composing patterns with easy-to-interpret conjunctive clauses in propositional logic. In this paper, we go beyond pattern classification by introducing a new type of TMs, namely, the Regression T…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “Regression Tsetlin Machine”
Faster Tsetlin Machines use clause indexing to speed inference and learning.
problem Overfitting and slow inference in Tsetlin Machines.
method Introduced a look-up table that indexes clauses based on feature falsification, enabling faster evaluation of clauses.
result Up to 15 times faster classification and three times faster learning on MNIST and Fashion-MNIST.
The paper introduces closed-form expressions for interpreting Tsetlin Machines.
problem Interpreting complex Tsetlin Machines with a large number of clauses.
method Developed closed-form expressions for local and global interpretability of Tsetlin Machines.
result The expressions enable real-time feature importance assessment and data clustering.
Improved RTM uses integer weights to reduce computation and increase interpretability.
problem Lack of interpretability in nonlinear regression models.
method Integer weighted RTM clauses, combined with a novel learning scheme.
result Significantly reduced computation cost with improved accuracy.
Medical applications challenge today's text categorization techniques by demanding both high accuracy and ease-of-interpretation. Although deep learning has provided a leap ahead in accuracy, this leap comes at the sacrifice of interpretability. To address this accuracy-interpretability challenge, we here introduce, fo…
A fast model estimates future prices from orderbook data.
problem Estimating future prices from orderbook data.
method Hyperdimensional vector Tsetlin machine framework for fast estimation.
result Demonstrated robust estimate of future prices.
The recently introduced Tsetlin Machine (TM) has provided competitive pattern recognition accuracy in several benchmarks, however, requires a 3-dimensional hyperparameter search. In this paper, we introduce the Multigranular Tsetlin Machine (MTM). The MTM eliminates the specificity hyperparameter, used by the TM to con…
The Tsetlin Machine (TM) is an interpretable mechanism for pattern recognition that constructs conjunctive clauses from data. The clauses capture frequent patterns with high discriminating power, providing increasing expression power with each additional clause. However, the resulting accuracy gain comes at the cost of…
Convolutional neural networks (CNNs) have obtained astounding successes for important pattern recognition tasks, but they suffer from high computational complexity and the lack of interpretability. The recent Tsetlin Machine (TM) attempts to address this lack by using easy-to-interpret conjunctive clauses in propositio…
This paper is devoted to an elementary new construction of -singular Gelfand-Tsetlin modules using complex geometry. We introduce a universal ring together with the vector space with basis formed from some local distributi…
The purpose of this note is to give a simple description of a (complete) family of functions in involution on certain hermitian symmetric spaces. This family, obtained via bi-hamiltonian approach using the Bruhat Poisson structure, is especially simple for the projective spaces, where the formulas in terms of the momen…
Complete integrability from Poisson-Nijenhuis structures on compact hermitian symmetric spacesmath.SG
We study a class of Poisson-Nijenhuis systems defined on compact hermitian symmetric spaces, where the Nijenhuis tensor is defined as the composition of Kirillov-Konstant-Souriau symplectic form with the so called Bruhat-Poisson structure. We determine its spectrum. In the case of Grassmannians the eigenvalues are the …
Ability for accurate hospital case cost modelling and prediction is critical for efficient health care financial management and budgetary planning. A variety of regression machine learning algorithms are known to be effective for health care cost predictions. The purpose of this experiment was to build an Azure Machine…
Develops a direct debiased machine learning framework using Bregman divergence.
problem Reduces bias in machine learning estimates of causal effects or structural models.
method Neyman targeted estimation and generalized Riesz regression using Bregman divergence.
result Improves estimation of parameters of interest in causal models.
New ensemble SVM model reduces prediction error without choosing best kernel.
problem Reducing prediction error in regression problems.
method Bagged-weighted support vector regression model with random machines.
result Regression Random Machines achieve lower generalization error.
We consider the moduli space M_r of polygons with fixed side lengths in five-dimensional eucledian space. We analyze the local structure of its singularities and exhibit a real-analytic equivalence between M_r and a weighted quotient of the n-fold product of the quaternionic projective line HP^1 by the diagonal PSL(2,H…
Fundamentals of Regressionstat.ML
This chapter reviews classic regression methods and their evolution to physics-informed approaches.
problem Finding relationships between variables using regression.
method Introduces traditional and physics-informed regression methods, linking them to computational science.
result Regression methods have evolved from purely statistical to incorporating physical knowledge.
This paper aims to solve a basic problem in distributed statistical inference: how many machines can we use in parallel computing? In kernel ridge regression, we address this question in two important settings: nonparametric estimation and hypothesis testing. Specifically, we find a range for the number of machines und…
pystacked combines machine learning models for improved predictions.
problem Improving machine learning model performance through stacking.
method Stacked generalization using Python's scikit-learn with various base learners.
result Enhanced predictive models through combining multiple machine learning algorithms.
Classification outperforms regression in portfolio construction, yielding higher Sharpe ratios.
problem Determining which machine learning approach (classification vs. regression) is more effective for portfolio construction.
method Used stacking ensemble of gradient boosted tree, random forest, and neural network models.
result Classification yields higher Sharpe ratios and economically significant alphas compared to regression.
SparseChem speeds up ML for small molecules.
problem Training fast and accurate ML models for high-dimensional data.
method Supports millions of features and compounds, trains various models.
result Fast and accurate machine learning models for biochemical applications.
Study proves NN matching is equivalent to Riesz regression for debiased machine learning.
problem Addressing bias in machine learning models.
method Interprets NN matching as Riesz regression and derives it from LSIF.
result NN matching is shown to be equivalent to Riesz regression.
The paper debiases machine learning predictions to correct bias in regression coefficients.
problem Bias in regression coefficients from machine learning predictions.
method Proposes an adversarial machine learning algorithm to de-bias predictions.
result Adversarial predictions recover true coefficients, while naive predictions are biased.
Machine learning improves joint default assessment by capturing non-linear dependencies.
problem Capturing non-linear dependencies among covariates for accurate joint default assessment.
method Application of machine learning techniques to credit card dataset, comparing with logistic regression.
result Machine learning outperforms logistic regression in assessing portfolio riskiness.
Machine learning models predict brain age with systematic bias, corrected in this study.
problem Systematic bias in machine learning regression models for brain age prediction.
method General constrained optimization approach to correct bias.
result Our method effectively eliminates the bias from brain age predictions.
Analytical results for uncertainty propagation through trained machine learning regression modelscs.LG
The paper derives uncertainty quantification for ML models used in metrology.
problem Uncertainty quantification for ML models in metrology applications.
method Analytical expressions for mean and variance of model output are derived for various ML models.
result The derived expressions cover multiple ML models and are validated against Monte Carlo methods.
AI-generated variables bias regression estimates; methods correct for invalid inference.
problem Bias in regression estimates due to AI-generated variables.
method Two methods: bias correction and joint estimation.
result Valid inference restored through proposed methods.
Machine learning finds new natural laws from noisy data.
problem Discovery of natural laws relies on human inspiration.
method Recursive-LASSO-based symbolic regression (RLS) method.
result Data-driven formulation of natural laws from noisy data.
Novel quasi-Bayesian method for IV regression using machine learning models.
problem Uncertainty quantification in IV regression with machine learning models.
method Quasi-Bayesian procedure based on kernelized IV models and dual formulation.
result Established minimax optimal contraction rates and scalable inference algorithm.
Lecture notes on advanced linear regression methods.
problem Understanding the properties of linear regression estimators in high dimensions.
method Proposition-proof exploration of least squares, ridgeless, ridge, and lasso estimators.
result Detailed analysis of the existence, uniqueness, relations, computation, and non-asymptotic properties of these estimators.
This study compares multivariate vs univariate machine learning for multi-output regression.
problem When to use multivariate ensemble techniques over separate univariate models.
method Comparative analysis of different multivariate approaches for multi-output regression.
result Multivariate ensemble techniques outperform separate univariate models in simulations.
New tests compare regression functions using machine learning, overcoming dimensionality issues.
problem Comparing regression functions in high-dimensional settings.
method Generalized kernel-based conditional mean dependence, machine learning methods for flexible estimation.
result Established asymptotic properties of tests under fixed and high-dimensional regimes.
Isotonic regression binning affects calibration statistics of machine learning models.
problem Isotonic regression binning introduces aleatoric uncertainty in calibration statistics.
method Calibration error statistics are recalibrated using isotonic regression, which produces stratified uncertainties.
result Stratified uncertainties lead to significant differences in bin-based calibration statistics.
This work extends the scaling law to multiple and kernel regression, challenging traditional machine learning principles.
problem Challenging traditional machine learning wisdom with scaling law in large practical models.
method Demonstrates the scaling law in multiple and kernel regression settings.
result The scaling law extends to multiple and kernel regression, providing deeper insights into LLMs.
Machine Learning, Linear and Bayesian Models for Logistic Regression in Failure Detection Problemscs.LG
In this work, we study the use of logistic regression in manufacturing failures detection. As a data set for the analysis, we used the data from Kaggle competition Bosch Production Line Performance. We considered the use of machine learning, linear and Bayesian models. For machine learning approach, we analyzed XGBoost…
Quantum computing speeds up linear regression training.
problem Reducing training time for machine learning models.
method Formulated regression problem as QUBO, used D-Wave 2000Q for adiabatic optimization.
result Quantum approach achieves up to 2.8x speedup on larger datasets.
Collider regression improves predictive performance in regression tasks.
problem Discarding prior causal knowledge in regression tasks.
method Collider regression framework incorporating probabilistic causal knowledge from collider structures.
result Proves positive generalization benefit and provides closed-form estimators.
Paper uses machine learning for nowcasting corporate earnings from mixed-frequency data.
problem Predicting corporate earnings for a large cross-section of firms with different frequency data.
method Structured machine learning regressions with sparse-group LASSO regularization for panel data.
result Machine learning models outperform traditional methods in nowcasting corporate earnings.
A fast algorithm for generalized matrix regression improves machine learning performance.
problem Efficiently solving generalized matrix regression problems in machine learning.
method Utilizes sketching technique to achieve relative error with sketching sizes of order $\cO(ε^{-1/2})$.
result The Fast GMR algorithm achieves better performance in symmetric positive definite matrix approximation and single pass singular value decomposition.
Private machine learning framework using randomised response.
problem Private machine learning in adversarial environments.
method Randomised response for noisy data release.
result Consistent estimation of true machine learning model.
The study forecasts ETF return direction using machine learning models.
problem Predicting the direction of ETF returns for investment decisions.
method Applied regression and classification models to historical ETF component data.
result Models outperformed naive and buy & hold strategies, especially linear regression and logistic regression.
COVID-19 mortality analysis from soft-data multivariate curve regression and machine learningstat.ML
Study uses regression and ML for COVID-19 mortality forecasting.
problem Forecasting COVID-19 mortality during the first wave in Spain.
method Cyclical curve log-regression, multivariate time series spatial residual correlation analysis, Bayesian approach, machine learning.
result Empirical analysis shows ML regression models perform better than traditional methods.
The paper argues for using Neyman orthogonal score for balancing in debiased machine learning.
problem Debiased machine learning requires a proper approach to balance covariates.
method The paper advocates for using Riesz regression with basis functions of X for balancing.
result Covariate balancing is only valid when the score-relevant regression error is a function of covariates alone.
Quantile regression improves urban water demand forecasting.
problem Improving probabilistic urban water demand forecasting.
method Comparing five quantile regression algorithms and their combinations for one-day ahead forecasting.
result Linear boosting algorithm performs best for probabilistic urban water demand forecasting.
Study examines how imputation accuracy affects prediction accuracy in regression problems with missing covariates.
problem Missing covariates in regression or classification problems.
method Simulation and empirical analysis using UCI datasets and statistical inference.
result Imputation accuracy impacts prediction accuracy, especially with Machine Learning methods.
Locally adaptive interpretable regression improves linear regression's predictability.
problem Linear regression's predictability is limited; it lacks adaptability.
method Locally adaptive interpretable regression (LoAIR) uses neural networks to predict percentile of a Gaussian distribution for regression coefficients.
result LoAIR achieves comparable or better predictive performance than state-of-the-art baselines.
In this paper we formulate a regression problem to predict realized volatility by using option price data and enhance VIX-styled volatility indices' predictability and liquidity. We test algorithms including regularized regression and machine learning methods such as Feedforward Neural Networks (FNN) on S&P 500 Index a…
In this paper, we present a regression framework involving several machine learning models to estimate water parameters based on hyperspectral data. Measurements from a multi-sensor field campaign, conducted on the River Elbe, Germany, represent the benchmark dataset. It contains hyperspectral data and the five water p…