Wavelet denoised-ResNet with LightGBM predicts Forex rate of change.
problem Forecasting Foreign Exchange (Forex) rate of change for trading opportunities.
method Wavelet denoising, ResNet, LightGBM, technical indicators, image features.
result The model outperforms baseline models with low MAE, MSE, and RMSE.
Two new methods improve monotonic constraint enforcement in regression and classification trees.
problem Improving monotonic constraints in regression and classification trees.
method Proposed two new methods: one yields better results than LightGBM, the other yields even better results but is slower.
result The best method consistently beats the current implementation of LightGBM, achieving up to 1% loss reduction.
Paper uses LightGBM for mobile user credit assessment.
problem Improving credit evaluation methods for communication operators.
method Data preprocessing, feature engineering, multiple machine learning models integration.
result Established a suitable fusion model for operator user credit evaluation.
New methods for quantifying insurance claim cost uncertainty using LightGBM and GLMs.
problem Quantifying prediction uncertainty in insurance claim costs.
method Proposed non-conformity measures for GLMs and GBMs with Tweedie loss.
result Locally weighted Pearson residuals outperform other methods in maintaining nominal coverage with smallest average width.
ARIMA model outperforms advanced forecasting models in predicting Walmart sales.
problem Forecasting volatile retail sales trends with unknown factors.
method Benchmarked traditional ARIMA model against advanced models like Prophet and LightGBM on historical Walmart sales data.
result ARIMA model outperforms LightGBM and achieves computational efficiency.
Optimizes LightGBM for stock market forecasting with novel feature engineering and transformation methods.
problem Accurately forecasting stock market fluctuations to mitigate risks.
method Feature engineering and transformation methods for LightGBM optimization.
result Log Returns, Returns and EMA Difference Ratio are the most effective target variable transformations.
The paper evaluates company investment value using machine learning models.
problem Evaluating the investment value of companies based on machine learning.
method Data mining, feature selection, cross-validation, stacking model, Bayesian Ridge Regression.
result The RMSE of the final model is 3.047, indicating improved stability and generalization.
LightGBM outperforms other models in predicting pH values in Georgia, USA.
problem Accurate water quality prediction for effective resource management and pollution mitigation.
method Five distinct predictive models (linear regression, Random Forest, XGBoost, LightGBM, MLP neural network) were assessed for pH value forecasting in Georgia, USA.
result LightGBM achieved the highest average precision in predicting pH values.
Study evaluates AD methods for fraud detection in online credit card payments.
problem Fraud detection in online credit card payments using anomaly detection methods.
method Assessed several recent anomaly detection methods and compared them with standard supervised learning methods.
result LightGBM outperforms other methods but is more sensitive to distribution shifts.
State-of-the-art implementations of boosting, such as XGBoost and LightGBM, can process large training sets extremely fast. However, this performance requires that the memory size is sufficient to hold a 2-3 multiple of the training set size. This paper presents an alternative approach to implementing the boosted trees…
Unified comparison of gradient boosting algorithms for insurance claims.
problem Improving predictive accuracy and computational efficiency in insurance claim prediction.
method Unified notation and comprehensive numerical study comparing 12 gradient boosting algorithms on 5 datasets.
result No trade-off between model adequacy and predictive accuracy.
Unified probabilistic gradient boosting for entire conditional distribution modeling.
problem Creating accurate probabilistic forecasts from regression tasks.
method Unified probabilistic gradient boosting framework using XGBoost and LightGBM, modeling conditional moments or CDF via Normalizing Flows.
result Achieves state-of-the-art forecast accuracy.
This paper compares machine learning methods for recognizing lane change intentions from vehicle trajectories.
problem Accurately detecting and predicting lane change processes in autonomous vehicles.
method Comparison of different machine learning methods on high-dimensional time series data.
result Ensemble methods reduce Type II and Type III classification errors, while LightGBM outperforms XGBoost in training efficiency.
New algorithms improve uncertainty estimation in satellite precipitation predictions.
problem Lack of uncertainty estimates in machine learning spatial precipitation predictions from satellite data.
method Benchmarked six algorithms including LightGBM, compared using quantile scoring functions and rules.
result LightGBM outperformed other algorithms in quantile scoring rule by 11.10%.
Machine learning models outperform traditional technical analysis in Bitcoin trading.
problem Maximizing profits in the Bitcoin market using trading signals.
method Comparison of machine learning models (LightGBM, LSTM) and technical analysis strategies (EMA, MACD+ADX).
result LSTM model achieved a 65.23% cumulative return over a year, significantly outperforming other strategies.
ETHGamDet detects crypto gambling contracts and addresses.
problem Identifying crypto gambling contracts and addresses.
method Multi-modal retrieval methods, LightGBM model with memory components.
result ETHGamDet achieves high F1-scores in address and contract classification.
Study improves forecasting of ED crowding using advanced ML models.
problem Improving forecasting of emergency department crowding.
method Advanced machine learning models (N-BEATS, LightGBM, DeepAR) using multivariable input data.
result N-BEATS and LightGBM outperform benchmarks in forecasting ED occupancy.
Gradient Boosting Decision Tree (GBDT) are popular machine learning algorithms with implementations such as LightGBM and in popular machine learning toolkits like Scikit-Learn. Many implementations can only produce trees in an offline manner and in a greedy manner. We explore ways to convert existing GBDT implementatio…
We present a novel approach for parallel computation in the context of machine learning that we call "Tell Me Something New" (TMSN). This approach involves a set of independent workers that use broadcast to update each other when they observe "something new". TMSN does not require synchronization or a head node and is …
A new framework integrates credit scoring into profit scoring for better P2P lending investments.
problem Maximizing profit while minimizing risk in P2P lending investments.
method Two-stage framework using Light Gradient Boosting Machine (lightGBM) to integrate credit scoring into profit scoring.
result The proposed framework identifies more profitable loans and provides better investment guidance.
Study uses synthetic data to estimate credit risk for underbanked consumers in Istanbul.
problem Estimating credit risk for underbanked consumers lacking formal credit records.
method Created synthetic dataset, used retrieval augmented generation, trained CatBoost, LightGBM, and XGBoost models.
result Alternative financial data improves credit risk estimation, raising AUC by 13%.
VAIOM models financial returns using continuous input and categorical output.
problem Modeling continuous, noisy, and heterogeneous financial data.
method VAIOM is a decoder-only Transformer that separates input representation from output likelihood.
result VAIOM models outperform fixed single-bar LightGBM baseline in both Test halves.
Enhanced LSTM predicts equity trends, outperforming traditional methods.
problem Nonstationary and nonlinear market regimes challenge trend forecasting.
method LSTM-based framework for forecasting equity trend differences.
result LSTM framework outperforms traditional methods in terms of overall PNL.
Federated machine learning systems have been widely used to facilitate the joint data analytics across the distributed datasets owned by the different parties that do not trust each others. In this paper, we proposed a novel Gradient Boosting Machines (GBM) framework SecureGBM built-up with a multi-party computation mo…
Model combination, often regarded as a key sub-field of ensemble learning, has been widely used in both academic research and industry applications. To facilitate this process, we propose and implement an easy-to-use Python toolkit, combo, to aggregate models and scores under various scenarios, including classification…
We outline an inherent weakness of tensor factorization models when latent factors are expressed as a function of side information and propose a novel method to mitigate this weakness. We coin our method \textit{Kernel Fried Tensor}(KFT) and present it as a large scale forecasting tool for high dimensional data. Our re…
Unified pipeline predicts equipment anomalies with high precision and reduced false positives.
problem Predicting equipment anomalies before failures using small models.
method Triplet Feature Fusion combining statistical, time-series, and text embeddings.
result Achieves high precision and reduced false positives.
Predicts academic risk in college students using interpretable machine learning.
problem Predicting academic risk from high-dimensional, unbalanced student data.
method Binary classification task using LightGBM model and Shapley value.
result 8 predictors for academic risk identified, including quality of academic partners and dormitory study atmosphere.
FraudTransformer detects payment fraud by preserving event order and time gaps.
problem Detecting payment fraud in real-world banking streams with irregular time gaps.
method Augments a GPT-style architecture with a dedicated time encoder and a learned positional encoder.
result FraudTransformer outperforms classical and transformer baselines, achieving highest AUROC and PRAUC on held-out test set.
StructureBoost improves gradient boosting for complex categorical variables efficiently.
problem Efficiently handling complex categorical variables with known structure.
method Two methods to overcome computational obstacles in SCDT enumeration for structured categorical variables.
result StructureBoost outperforms existing packages on complex categorical problems.
Residual Networks (ResNets) have become state-of-the-art models in deep learning and several theoretical studies have been devoted to understanding why ResNet works so well. One attractive viewpoint on ResNet is that it is optimizing the risk in a functional space by combining an ensemble of effective features. In this…
SAINT improves neural networks for tabular data with row attention and contrastive pre-training.
problem Tabular data challenges in machine learning applications.
method SAINT combines row and column attention with contrastive self-supervised pre-training.
result SAINT outperforms previous deep learning methods and even gradient boosting methods on benchmark tasks.
agtboost speeds up gradient tree boosting with automatic complexity adjustment.
problem Speeding up and simplifying gradient tree boosting computations.
method Adaptive gradient tree boosting with automatic complexity adjustment and feature importance.
result Significant decrease in computation time and simplification of model complexity.
We analyze the accuracy of traffic simulations metamodels based on neural networks and gradient boosting models (LightGBM), applied to traffic optimization as fitness functions of genetic algorithms. Our metamodels approximate outcomes of traffic simulations (the total time of waiting on a red signal) taking as an inpu…
Gradient boosted decision trees (GBDT) is the leading algorithm for many commercial and academic data applications. We give a deep analysis of this algorithm, especially the histogram technique, which is a basis for the regulized distribution with compact support. We present three new modifications. 1) Share memory tec…
BoostForest combines multiple BoostTree models for improved accuracy.
problem Improving ensemble learning performance.
method BoostTree uses gradient boosting and random cut-points. BoostForest bootstraps training data and randomly samples parameters.
result BoostForest outperforms classical ensemble methods on 35 datasets.
In the regression problem, L1 and L2 are the most commonly used loss functions, which produce mean predictions with different biases. However, the predictions are neither robust nor adequate enough since they only capture a few conditional distributions instead of the whole distribution, especially for small datasets. …
Study improves detection of cryptocurrency pump-and-dump schemes.
problem Class imbalance in P&D detection due to rare events.
method Synthetic Minority Oversampling Technique (SMOTE) and ensemble learning models.
result XGBoost and LightGBM achieved high recall rates (94.87% and 93.59%) with strong F1-scores.
Machine learning models predict the behavior of negatively buoyant jets from wastewater.
problem Minimizing harmful effects of negatively buoyant jets during wastewater discharge.
method Training machine learning models (ANN, XGBoost, CatBoost, LightGBM) on OpenFOAM simulations and experimental data.
result Artificial Neural Network provided the best prediction with R2 0.98 and RMSE 0.28.
This study evaluates feature scaling across 14 datasets and 12 techniques in ML.
problem Impact of feature scaling on machine learning performance and computational costs.
method Systematic evaluation of 12 scaling techniques across 14 datasets and 16 ML algorithms.
result Wide variation in model performance due to feature scaling, especially for non-ensemble models.
This study extends verifiable learning to boosted tree ensembles, enabling efficient security verification.
problem Efficiently verifying the robustness of boosted tree ensembles against norm-based attackers.
method Formal verification of robustness for large-spread boosted tree ensembles, considering L∞-norm and pseudo-polynomial time for Lp-norm verification. result Polynomial time verification for L∞-norm attackers, NP-hard for other norms, and pseudo-polynomial time for Lp-norm verification. The M5 competition tackles overdispersed retail sales forecasting with GAMLSS.
problem Overdispersed and zero-inflated retail sales data.
method Distributional forecasting using GAMLSS framework.
result GAMLSS provides better probabilistic forecasting for count data.
Gradient boosting decision trees (GBDTs) have seen widespread adoption in academia, industry and competitive data science due to their state-of-the-art performance in many machine learning tasks. One relative downside to these models is the large number of hyper-parameters that they expose to the end-user. To maximize …
Study predicts startup outcomes like funding, patenting, IPOs using machine learning.
problem Forecasting startup success metrics like funding, patenting, IPOs.
method Developed interpretable machine learning framework, used preprocessing, class imbalance handling, and compared multiple models.
result Achieved high AUROC values for patent, funding, and exit predictions.
Paper presents a light-weight CNN model for Parkinson's disease diagnosis.
problem Diagnosing Parkinson's disease efficiently and accurately.
method A light-weight CNN model cascading to LSTM for time-series signals.
result The model achieves high-quality results with fewer parameters and operations.
k-Nearest Neighbors is one of the most fundamental but effective classification models. In this paper, we propose two families of models built on a sequence to sequence model and a memory network model to mimic the k-Nearest Neighbors model, which generate a sequence of labels, a sequence of out-of-sample feature vecto…
The paper compares advanced deep learning models for Indian stock price forecasting.
problem Complexity of stock price forecasting due to numerous influencing factors.
method Utilizes historical data from national banks in India, combines deep learning models and sentiment analysis.
result Achieved higher accuracy in stock price forecasting compared to traditional methods.
Interpreting predictions from tree ensemble methods such as gradient boosting machines and random forests is important, yet feature attribution for trees is often heuristic and not individualized for each prediction. Here we show that popular feature attribution methods are inconsistent, meaning they can lower a featur…