FEALM learns features for better nonlinear DR of hidden patterns.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Consensus dimension reduction combines multiple visualizations to identify shared patterns.
KineticSim: A lightweight, high-performance execution engine for real-time market simulators
New method reduces state redundancy in HSMM for driving patterns.
Rdimtools simplifies DR and IDE for high-dimensional data analysis.
This work explains RL policies using causal models, revealing important patterns and failures.
Recently, hybrid metaheuristics have become a trend in operations research. A successful example combines the Greedy Randomized Adaptive Search Procedures (GRASP) and data mining techniques, where frequent patterns found in high-quality solutions can lead to an efficient exploration of the search space, along with a si…
CAG method predicts nonlinear solid mechanics responses in real-time with high accuracy and efficiency.
Research from a variety of fields including psychology and linguistics have found correlations and patterns in personal attributes and behavior, but efforts to understand the broader heterogeneity in human behavior have not yet integrated these approaches and perspectives with a cohesive methodology. Here we extract pa…
Research optimizes C++ patterns for HFT, reducing latency and improving profitability.
The paper presents the application of Variational Autoencoders (VAE) for data dimensionality reduction and explorative analysis of mass spectrometry imaging data (MSI). The results confirm that VAEs are capable of detecting the patterns associated with the different tissue sub-types with performance than standard appro…
Random forests reduce bias and variance, especially in low SNR settings.
In this work we propose a method for reducing the dimensionality of tensor objects in a binary classification framework. The proposed Common Mode Patterns method takes into consideration the labels' information, and ensures that tensor objects that belong to different classes do not share common features after the redu…
The fastICA method is a popular dimension reduction technique used to reveal patterns in data. Here we show both theoretically and in practice that the approximations used in fastICA can result in patterns not being successfully recognised. We demonstrate this problem using a two-dimensional example where a clear struc…
Bayesian calibration improves ABMs for predicting travel patterns.
The analysis of observed conditional distributions of both lagged and simultaneous intraday price increments of a basket of stocks reveals phenomena of dependence - induced volatility smile and kurtosis reduction. A model based on multivariate t-Student distribution shows that the observed effects are caused by colelct…
This paper proposes a probabilistic neural network developed on the basis of time-series discriminant component analysis (TSDCA) that can be used to classify high-dimensional time-series patterns. TSDCA involves the compression of high-dimensional time series into a lower-dimensional space using a set of orthogonal tra…
Objective: To evaluate unsupervised clustering methods for identifying individual-level behavioral-clinical phenotypes that relate personal biomarkers and behavioral traits in type 2 diabetes (T2DM) self-monitoring data. Materials and Methods: We used hierarchical clustering (HC) to identify groups of meals with simila…
The characteristics (or numerical patterns) of a feature vector in the transform domain of a perturbation model differ significantly from those of its corresponding feature vector in the input domain. These differences - caused by the perturbation techniques used for the transformation of feature patterns - degrade the…
The commercialization of deep learning creates a compelling need for intellectual property (IP) protection. Deep neural network (DNN) watermarking has been proposed as a promising tool to help model owners prove ownership and fight piracy. A popular approach of watermarking is to train a DNN to recognize images with ce…
HIV RNA viral load (VL) is an important outcome variable in studies of HIV infected persons. There exists only a handful of methods which classify patients by viral load patterns. Most methods place limits on the use of viral load measurements, are often specific to a particular study design, and do not account for com…
SPREV simplifies visualization of complex labeled datasets.
Consumer Demand Response (DR) is an important research and industry problem, which seeks to categorize, predict and modify consumer's energy consumption. Unfortunately, traditional clustering methods have resulted in many hundreds of clusters, with a given consumer often associated with several clusters, making it diff…
Spatio-temporal data compression method reduces memory usage.
Discovering statistical structure from links is a fundamental problem in the analysis of social networks. Choosing a misspecified model, or equivalently, an incorrect inference algorithm will result in an invalid analysis or even falsely uncover patterns that are in fact artifacts of the model. This work focuses on uni…
Predicts local AQI using mobile sensor data, improving accuracy by 71.654 MSE.
KineticSim accelerates financial market simulations 3406x over CPU.
Study uses NMF to reduce cancer microarray data dimensions.
A new geometry-preserving method for interpreting compositional data.
Deep learning is a form of machine learning for nonlinear high dimensional pattern matching and prediction. By taking a Bayesian probabilistic perspective, we provide a number of insights into more efficient algorithms for optimisation and hyper-parameter tuning. Traditional high-dimensional data reduction techniques, …
We consider dimensional reduction of gauge theories with arbitrary gauge group in a formalism based on equivariant principal bundles. For the classical gauge groups we clarify the relations between equivariant principal bundles and quiver bundles, and show that the reduced quiver gauge theories are all generically buil…
Because of high dimensionality, correlation among covariates, and noise contained in data, dimension reduction (DR) techniques are often employed to the application of machine learning algorithms. Principal Component Analysis (PCA), Linear Discriminant Analysis (LDA), and their kernel variants (KPCA, KLDA) are among th…
Probabilistic mixture models have been widely used for different machine learning and pattern recognition tasks such as clustering, dimensionality reduction, and classification. In this paper, we focus on trying to solve the most common challenges related to supervised learning algorithms by using mixture probability d…
TCR simplifies complex models into interpretable causal factors.
MSFA clusters high-dimensional spatial data using spline-based covariance structures.
Reduces data leakage in distributed deep learning models.
New method allows sheets to morph into multiple shapes via spatially varying stimuli.
Interactive tool for better understanding t-SNE projections.
While the existence of low-dimensional embedding manifolds has been shown in patterns of collective motion, the current battery of nonlinear dimensionality reduction methods are not amenable to the analysis of such manifolds. This is mainly due to the necessary spectral decomposition step, which limits control over the…
A novel supervised visualization technique for data exploration.
Optimal energy trading strategy for intraday markets using Hawkes processes.
We propose norm regularized quadratic surface support vector machine models for binary classification in supervised learning. We establish their desired theoretical properties, including the existence and uniqueness of the optimal solution, reduction to the standard SVMs over (almost) linearly separable data s…
t-SNE fails to reveal clusters even in well-clusterable data.
Patient subtyping based on temporal observations can lead to significantly nuanced subtyping that acknowledges the dynamic characteristics of diseases. Existing methods for subtyping trajectories treat the evolution of clinical observations as a homogeneous process or employ data available at regular intervals. In real…
We present function preserving projections (FPP), a scalable linear projection technique for discovering interpretable relationships in high-dimensional data. Conventional dimension reduction methods aim to maximally preserve the global and/or local geometric structure of a dataset. However, in practice one is often mo…
SDR outperforms IDR in multimodal data analysis, especially with fewer samples.
A new method for real-time anomaly detection in flight data.
Evaluating data separation in a geometrical space is fundamental for pattern recognition. A plethora of dimensionality reduction (DR) algorithms have been developed in order to reveal the emergence of geometrical patterns in a low dimensional visible representation space, in which high-dimensional samples similarities …