In short, our experiments suggest that yes, on average, rotation forest is better than the most common alternatives when all the attributes are real-valued. Rotation forest is a tree based ensemble that performs transforms on subsets of attributes prior to constructing each tree. We present an empirical comparison of c…
New TSER algorithms outperform existing methods in time series extrinsic regression.
problem Improving time series extrinsic regression models.
method Extended TSER archive, introduced two new algorithms (FreshPRINCE and DrCIF), compared with rotation forest.
result DrCIF and FreshPRINCE models significantly outperform existing methods.
We demonstrate that, for a range of state-of-the-art machine learning algorithms, the differences in generalisation performance obtained using default parameter settings and using parameters tuned via cross-validation can be similar in magnitude to the differences in performance observed between state-of-the-art and un…
Study examines how disturbances affect financial returns in Austrian forests.
problem Financial impact of disturbances on timberland returns in Austria.
method Applied probability theory to analyze two management regimes: even-aged and semi-stationary.
result Severe disturbances can lead to a shift from continuous-cover to even-aged forestry, affecting financial sensitivity.
Gradient-free ensemble learns sector forecasts from diverse models.
problem Predicting sector returns in a volatile market.
method Dynamic model combination using out-of-sample R-squared.
result Ensemble outperforms individual models in sector rotation.
Develops a numerical algorithm for stochastic impulse control using regression surrogates.
problem Optimal impulse control in stochastic processes.
method Generates statistical surrogates for continuation and intervention functions, recursively trained over simulated state trajectories.
result Demonstrates flexibility and extensibility of the numerical scheme through case studies.
Factor analysis or sometimes referred to as variable analysis has been extensively used in classification problems for identifying specific factors that are significant to particular classes. This type of analysis has been widely used in application such as customer segmentation, medical research, network traffic, imag…
iMondrian forest combines isolation forest and Mondrian forest for better anomaly detection.
problem Anomaly detection in batch and online settings.
method Hybrid of isolation forest and Mondrian forest, using depth in Mondrian forest structure.
result iMondrian forest outperforms existing methods in batch and online settings.
Study on rotating surfaces in 4D space with matrices.
problem Understanding rotational surfaces in pseudo-Euclidean 4-space.
method Defined hyperbolic and elliptic rotational surfaces using curves and matrices in 4D semi-Euclidean space.
result Generated rotated surfaces using specific rotation matrices.
A new transform links rotating calorons to solutions of a differential equation.
problem Existence and characterization of rotating calorons.
method Formulated a Nahm transform to relate rotating calorons to solutions of a delayed-differential equation.
result Existence of an eight-parameter family of rotating calorons with nontrivial holonomy.
We define general rotational surfaces of elliptic and hyperbolic type in the pseudo-Euclidean 4-space with neutral metric which are analogous to the general rotational surfaces of C. Moore in the Euclidean 4-space. We study Lorentz general rotational surfaces with plane meridian curves and give the complete classificat…
Ensembles of randomized decision trees, usually referred to as random forests, are widely used for classification and regression tasks in machine learning and statistics. Random forests achieve competitive predictive performance and are computationally efficient to train and test, making them excellent candidates for r…
The paper defines and analyzes homotopic rotation sets for surfaces of higher genus.
problem Defining and analyzing homotopic rotation sets for surfaces of higher genus.
method Developed a definition and proved several results using the theory of Le Calvez and Tal.
result Found that the homotopic rotation set can imply the existence of infinitely many periodic orbits under certain conditions.
New random forest method provides optimal rates and confidence bands.
problem Improving random forest regression rates and constructing confidence bands.
method Proposed Ehrenfest centered purely random forests achieve optimal rates; used Gaussian approximation for supremum of empirical processes.
result Explicit asymptotic uniform confidence bands constructed for both random forest types.
RFpredInterval package builds prediction intervals for random forests and boosted forests.
problem Quantifying uncertainty in random forest and boosted forest point predictions.
method 16 methods to build prediction intervals with random forests and boosted forests.
result The proposed method outperforms existing methods in building prediction intervals.
We propose random hinge forests, a simple, efficient, and novel variant of decision forests. Importantly, random hinge forests can be readily incorporated as a general component within arbitrary computation graphs that are optimized end-to-end with stochastic gradient descent or variants thereof. We derive random hinge…
Improved random forest proximities capture data geometry.
problem Inaccurate random forest proximities do not reflect learned data geometry.
method Introduce RF-GAP: Geometry- and Accuracy-Preserving proximities.
result RF-GAP improves geometric representation in tasks like data imputation.
Study of timelike surfaces in Minkowski space with specific geometric properties.
problem Characterizing geometric properties of timelike surfaces in Minkowski space.
method Analytical study of two types of timelike general rotational surfaces.
result Explicit descriptions of minimal and surfaces with specific curvature properties.
The study characterizes loxodromes on specific rotational surfaces in 3D space.
problem Characterizing loxodromes on rotational surfaces with special geometric properties.
method Parametrizations and curvature/torsion calculations for loxodromes on various rotational surfaces.
result The loxodrome on a flat rotational surface is a general helix.
Deep forests enhance expressiveness exponentially with depth, not width or tree size.
problem Understanding the role of depth, width, and tree size in deep forest performance.
method Provided upper and lower bounds on deep forest approximation complexity.
result Depth exponentially enhances deep forest expressiveness.
tl;dr: no, it cannot, at least not on average on the standard archive problems. We assess whether using six smoothing algorithms (moving average, exponential smoothing, Gaussian filter, Savitzky-Golay filter, Fourier approximation and a recursive median sieve) could be automatically applied to time series classificatio…
Enhanced rotation prediction improves SSL models by capturing both shape and texture information.
problem Rotation prediction misses texture information, limiting model performance.
method Introduces image enhanced rotation prediction (IE-Rot) that combines rotation and image enhancement tasks.
result IE-Rot models outperform Rotation on various benchmarks.
General rotational surfaces as a source of examples of surfaces in the four-dimensional Euclidean space have been introduced by C. Moore. In this paper we consider the analogue of these surfaces in the Minkowski 4-space. On the base of our invariant theory of spacelike surfaces we study general rotational surfaces with…
This paper improves forest pruning to balance accuracy and interpretability.
problem Limited interpretability of regression forests.
method Lasso-pruning and theoretical analysis of regression forests.
result Pruned regression forests can achieve equal or better accuracy than unpruned ones, with significant size reduction.
This paper is a comment on the survey paper by Biau and Scornet (2016) about random forests. We focus on the problem of quantifying the impact of each ingredient of random forests on their performance. We show that such a quantification is possible for a simple pure forest , leading to conclusions that could apply more…
Forest-guided smoothing uses random forest outputs for interpretable local smoothers.
problem Creating interpretable local smoothers from complex random forest outputs.
method Uses random forest outputs to define spatially adaptive bandwidth matrices for a linear smoother.
result Improves interpretability and applicability of random forest outputs for various analyses.
In this paper we propose using the principle of boosting to reduce the bias of a random forest prediction in the regression setting. From the original random forest fit we extract the residuals and then fit another random forest to these residuals. We call the sum of these two random forests a \textit{one-step boosted …
Rotation systems can't always be drawn in surfaces.
problem Rotation systems and simple drawings in surfaces.
method Extended the plane result to all fixed surfaces.
result Existence of rotation systems not arising from simple drawings in any fixed surface.
This paper proposes a set of rules to revise various neural networks for 3D point cloud processing to rotation-equivariant quaternion neural networks (REQNNs). We find that when a neural network uses quaternion features under certain conditions, the network feature naturally has the rotation-equivariance property. Rota…
RotEqNet preserves rotation symmetry in fluid systems using high-order tensors.
problem Lack of rotational symmetry in machine learning models for fluid systems.
method Introduces RotEqNet, a network that guarantees rotation-equivariance for high-order tensors.
result RotEqNet reduces errors and maintains rotation-equivariance in fluid systems.
By seeking the narrowest prediction intervals (PIs) that satisfy the specified coverage probability requirements, the recently proposed quality-based PI learning principle can extract high-quality PIs that better summarize the predictive certainty in regression tasks, and has been widely applied to solve many practical…
Improves time series classification with forest proximities.
problem Time series classification accuracy and efficiency.
method PF-GAP, an extension of RF-GAP proximities to proximity forests, combined with Multi-Dimensional Scaling and Local Outlier Factors.
result Forest proximities show stronger connection between misclassified points and outliers.
The paper applies Clairaut's theorem to rotational surfaces in pseudo-Euclidean 4-space.
problem Exploring geodesic curves on rotational surfaces in pseudo-Euclidean 4-space.
method Expressing Clairaut's theorem and deriving equations for geodesic curves.
result Characterization of geodesic curves on hyperbolic and elliptic surfaces of rotation.
Random forests reduce bias and variance, especially in low SNR settings.
problem Reducing bias and variance in machine learning models, particularly in low SNR scenarios.
method Empirical study of random forests and bagging ensembles, focusing on the importance of mtry tuning. result Random forests reduce both bias and variance, outperforming bagging ensembles in high SNR settings.
New random forest variants achieve optimal performance in high dimensions.
problem Handling dependencies between features in high-dimensional data.
method Using oblique splits in random forests with general split directions.
result Achieved minimax optimal convergence rates in arbitrary dimension.
Enhances random forest consistency and introduces DMRF for improved performance.
problem Improving the consistency and efficiency of random forest algorithms.
method Strengthened proof methods and propose DMRF algorithm.
result DMRF achieves better theoretical and experimental performance than previous variants.
Convolutional networks are successful due to their equivariance/invariance under translations. However, rotatable data such as images, volumes, shapes, or point clouds require processing with equivariance/invariance under rotations in cases where the rotational orientation of the coordinate system does not affect the m…
We consider n-dimensional discrete motions such that any two neighbouring positions correspond in a pure rotation ("rotating motions"). In the Study quadric model of Euclidean displacements these motions correspond to quadrilateral nets with edges contained in the Study quadric ("rotation nets"). The main focus of ou…
Online random forests improve Q-learning performance in specific gym environments.
problem Improving Q-learning performance in reinforcement learning tasks.
method Proposed online random forests as Q-function approximators and growing them as learning progresses.
result Improved performance over state-of-the-art Deep Q-Networks in specific gym environments.
Empirical evidence shows that ensembles, such as bagging, boosting, random and rotation forests, generally perform better in terms of their generalization error than individual classifiers. To explain this performance, Schapire et al. (1998) developed an upper bound on the generalization error of an ensemble based on t…
Minimal sets of moves for rotational Reidemeister diagrams are identified.
problem Understanding the minimal sets of moves for rotational Reidemeister diagrams.
method Detailed description and proof of minimal generating sets for rotational Reidemeister moves.
result Minimal generating sets for oriented, framed links contain 5 moves.
New method learns representations for decision forests using input perturbation.
problem Decision forests struggle with raw structured data and lack effective representations.
method Approximate decision forest gradients through input perturbation.
result Effective representation learning for decision forests without structural changes.
Improved random forest models enhance machine learning predictions.
problem Equal weights for random forest base decision trees are not optimal.
method Proposes algorithms to modify weighting strategy of regular random forest.
result Numerical results show significant improvements over regular random forest.
Introduced by Breiman, Random Forests are widely used classification and regression algorithms. While being initially designed as batch algorithms, several variants have been proposed to handle online learning. One particular instance of such forests is the \emph{Mondrian Forest}, whose trees are built using the so-cal…
New method studies moving points on curves using rotating frames.
problem Understanding the motion of points on curves.
method Constructing rotating frames for curves and analyzing the motion of points within these frames.
result A new binary mathematical formation mechanism for curves based on linear and rotational motion.
Study on rotational hypersurfaces with constant Gauss-Kronecker curvature.
problem Exploring hypersurfaces with constant Gauss-Kronecker curvature.
method Solving ODE for generating curves and analyzing geometric properties.
result Discovery of non-compact rotational hypersurfaces with negative Gauss-Kronecker curvature and finite volume.
In-plane drill rotations are impossible for smooth shells.
problem In-plane drill rotations on smooth shells are impossible.
method Analyzing the differential geometry of surfaces and isometries.
result Any isometry that coincides with the given surface at a portion of the boundary is the identity.
Positive factorization found for a specific map on surfaces.
problem Balanced superelliptic rotation on surfaces.
method Positive factorization approach.
result Positive factorization for balanced superelliptic rotation.