The rebmix package provides R functions for random univariate and multivariate finite mixture model generation, estimation, clustering and classification. The paper is focused on multivariate normal mixture models with unrestricted variance-covariance matrices. The objective is to show how to generate datasets for a kn…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “multivariate parameters”
This study defines a multivariate Self--Exciting Threshold Autoregressive with eXogenous input (MSETARX) models and present an estimation procedure for the parameters. The conditions for stationarity of the nonlinear MSETARX models is provided. In particular, the efficiency of an adaptive parameter estimation algorithm…
A neural network with a single hidden layer can't represent certain multivariable functions.
problem Representing certain multivariable functions with a neural network having only one hidden layer.
method Developed a continuum version of a one-hidden-layer neural network with ReLU activation, and proved constraints on its parameters and second derivative.
result Existence of a smooth binary function that cannot be precisely represented by any such neural network.
Identifies interpretable generative model for multivariate data.
problem Black-box architectures of deep generative models are often unidentified and difficult to interpret.
method Introduces Deep Discrete Encoder (DDE) Copula, a hierarchical binary latent variable model inside a copula framework.
result Establishes conditions for identification of DDE copula parameters and proves posterior consistency.
Paper introduces a new risk measure for multivariate residual estimation.
problem Quantifying residual estimation risk in complex financial models.
method Developed a multivariate framework for residual estimation risk, defined using various risk measures, and proposed a back-testing criterion.
result Demonstrated the effectiveness of the new measure through back-testing on retail credit portfolios.
New method uses KL-divergence to create non-informative priors for multivariate Gaussian.
problem Handling hyperparameters for non-informative limits in multivariate Gaussian conjugate priors.
method Using scaled KL-divergence between multivariate Gaussians to construct Wishart and normal-Wishart conjugate priors.
result Forming non-informative priors without violating Wishart shape parameter restrictions.
This paper presents a new model called infinite mixtures of multivariate Gaussian processes, which can be used to learn vector-valued functions and applied to multitask learning. As an extension of the single multivariate Gaussian process, the mixture model has the advantages of modeling multimodal data and alleviating…
Paper introduces COBRA variations for multivariate time series forecasting.
problem Multivariate time series forecasting challenges.
method Innovative COBRA variations, data preprocessing, Bayesian optimisation vs. grid search.
result Proposed methodologies outperform state-of-the-art models.
Regularized MFPCA smooths multivariate functional data for clearer patterns.
problem Challenges in controlling roughness of multivariate functional PCs.
method ReMFPCA incorporates a roughness penalty in a penalized framework to smooth PCs.
result Smoothed multivariate functional PCs reveal clearer patterns.
We propose a family of multivariate Gaussian process models for correlated outputs, based on assuming that the likelihood function takes the generic form of the multivariate exponential family distribution (EFD). We denote this model as a multivariate generalized Gaussian process model, and derive Taylor and Laplace al…
Multivariate Bayesian Last Layer for Regression with Uncertainty Quantification and Decompositionstat.ML
Bayesian neural network models improve uncertainty quantification in multivariate regression.
problem Uncertainty quantification in multivariate regression models with heteroscedastic noise.
method Proposes Bayesian Last Layer neural network models and EM algorithms for parameter learning.
result Capable of disentangling aleatoric and epistemic uncertainty.
Process capability index (PCI) is a commonly used statistic to measure ability of a process to operate within the given specifications or to produce products which meet the required quality specifications. PCI can be univariate or multivariate depending upon the number of process specifications or quality characteristi…
New matching estimators correct bias in multivariate settings without smoothing parameters.
problem Bias in nearest-neighbor and matching estimators in multiple dimensions.
method Polynomial least squares fits on Voronoi tessellations.
result Novel estimators converge at rate under mild smoothness assumptions.
CATS enhances MTSF by generating ATS from OTS to improve forecasting accuracy.
problem Recent deep learning models often outperform multivariate ones in MTSF.
method CATS constructs ATS from OTS using a 2D temporal-contextual attention mechanism.
result CATS achieves state-of-the-art performance with reduced complexity.
A new model uses neural networks to efficiently learn multivariate temporal point processes.
problem Efficiently modeling multivariate temporal point processes with low parameter complexity.
method Modeling the cumulative hazard function with neural networks for each variate.
result The proposed model achieves state-of-the-art performance on data fitting and event prediction tasks.
Proposes MinPEN framework for estimating relationships in multivariate models.
problem Estimating relationships between multivariate outcomes in statistical learning.
method MinPEN framework using minimum function penalty for non-convex optimization.
result Theoretical and practical validation of MinPEN framework for multivariate models.
This paper generalize [7](math.GT/0601291): We construct new links invariants from g, a type I basic classical Lie superalgebra. The construction uses the existence of an unexpected replacement of the vanishing quantum dimension of typical module. Using this, we get a multivariable link invariant associated to any one …
CATS adapts multivariate time series models by addressing correlation shift.
problem Correlation differences across domains in multivariate time series data.
method CATS introduces correlation shift to measure domain differences, and uses a graph attention module and temporal convolution to align target correlations with source correlations.
result CATS increases over 10% average accuracy compared to vanilla Transformer-based models with minimal additional parameters.
Paper proposes copula-based models for analyzing multivariate zero-inflated continuous data.
problem Challenges in analyzing multivariate zero-inflated continuous data with mixed discreteness and continuity.
method Proposes two copula-based density estimation models and rectified Gaussian copula.
result Demonstrates superior performance compared to conventional methods.
This paper solves the convergence problem for estimating MGGD parameters with a convex formulation.
problem Establishing convergence properties for estimating MGGD parameters with unknown mean and precision matrix.
method Proposes a convex formulation with well-established convergence properties for robust estimation in noisy scenarios.
result Demonstrates improved accuracy in precision and covariance matrix estimation compared to existing methods.
Study analyzes stock market correlations using multivariate distributions.
problem Capturing the correlation structure of complex, non-stationary systems.
method Applied Random Matrix Model to empirical data of 479 US stocks.
result Described and quantified changes in empirical distributions due to non-stationarity.
Multivariate Rough Volatilityq-fin.ST
Modeling joint log-volatility dynamics with multivariate fractional Ornstein-Uhlenbeck process.
problem Empirical evidence of joint behavior in realized volatility time series.
method Multivariate fractional Ornstein-Uhlenbeck process with different Hurst exponents and non-trivial interdependencies.
result Model accurately captures asymmetries and spillover effects in realized-volatility time series.
We introduce a multivariate Hawkes process with constraints on its conditional density. It is a multivariate point process with conditional intensity similar to that of a multivariate Hawkes process but certain events are forbidden with respect to boundary conditions on a multidimensional constraint variable, whose evo…
New model reduces volatility parameters and complexity.
problem Accurately modeling multivariate volatility with network structure.
method Introduces a new multivariate volatility model using both low and high-frequency data.
result The model significantly reduces parameter count and computational complexity.
We consider the problem of stochastic comparison of general Garch-like processes, for different parameters and different distributions of the innovations. We identify several stochastic orders that are propagated from the innovations to the Garch process itself, and discuss their interpretations. We focus on the convex…
We develop Square Root Graphical Models (SQR), a novel class of parametric graphical models that provides multivariate generalizations of univariate exponential family distributions. Previous multivariate graphical models [Yang et al. 2015] did not allow positive dependencies for the exponential and Poisson generalizat…
Mixture modelling involves explaining some observed evidence using a combination of probability distributions. The crux of the problem is the inference of an optimal number of mixture components and their corresponding parameters. This paper discusses unsupervised learning of mixture models using the Bayesian Minimum M…
A family of parsimonious Gaussian cluster-weighted models is presented. This family concerns a multivariate extension to cluster-weighted modelling that can account for correlations between multivariate responses. Parsimony is attained by constraining parts of an eigen-decomposition imposed on the component covariance …
We present the first adaptive strategy for active learning in the setting of classification with smooth decision boundary. The problem of adaptivity (to unknown distributional parameters) has remained opened since the seminal work of Castro and Nowak (2007), which first established (active learning) rates for this sett…
Bayesian DDR models complex multivariate distributions.
problem Modeling relationships between multivariate distributions with differing dimensions.
method Generalized Bayesian framework using sliced Wasserstein distance and MALA for inference.
result Posterior consistency and robust fits demonstrated in simulations and real data.
New algorithms for interpreting complex multivariate functions.
problem Hard interpretation of multivariate functions due to many parameters.
method Filtered tensor decompositions of derivative information.
result Nonparametric estimates of smooth decoupled functions.
Mixtures of multivariate contaminated shifted asymmetric Laplace distributions are developed for handling asymmetric clusters in the presence of outliers (also referred to as bad points herein). In addition to the parameters of the related non-contaminated mixture, for each (asymmetric) cluster, our model has one param…
A 'Gibbs-Newton' Technique for Enhanced Inference of Multivariate Polya Parameters and Topic Modelscs.LG
Hyper-parameters play a major role in the learning and inference process of latent Dirichlet allocation (LDA). In order to begin the LDA latent variables learning process, these hyper-parameters values need to be pre-determined. We propose an extension for LDA that we call 'Latent Dirichlet allocation Gibbs Newton' (LD…
NGBoost boosts multivariate probabilistic regression.
problem Joint probabilistic regression for multivariate targets.
method Natural Gradient Boosting for nonparametric modeling.
result Competitive performance in oceanographic velocity prediction.
Proposes a generalized XGBoost method for nonconvex loss functions.
problem Limited to convex loss functions in XGBoost.
method Extends XGBoost to use nonconvex loss functions and multivariate loss functions.
result Generalized XGBoost method can model multiple parameters in various distributions.
A new clustering method for functional data using skewed distributions.
problem Clustering functional data with skewed distributions.
method Mixtures of functional linear regression models and three skewed multivariate distributions (variance-gamma, skew-t, normal-inverse Gaussian).
result The proposed method funWeightClustSkew performs well on simulated and real data.
It is now widely accepted that volatility models have to incorporate the so-called leverage effect in order to to model the dynamics of daily financial returns.We suggest a new class of multivariate power transformed asymmetric models. It includes several functional forms of multivariate GARCH models which are of great…
New model for multivariate discrete event data with flexible interactions.
problem Modeling multivariate discrete event data with categorical interactions.
method Developed a new modeling approach with convex constraints, two estimation procedures (LS and ML).
result Proposed model can capture arbitrary shapes of historical event influence.
We present a new method for estimating multivariate, second-order stationary Gaussian Random Field (GRF) models based on the Sparse Precision matrix Selection (SPS) algorithm, proposed by Davanloo et al. (2015) for estimating scalar GRF models. Theoretical convergence rates for the estimated between-response covariance…
Improved model for multivariate time series prediction with simpler architecture.
problem Multivariate probabilistic time series prediction challenges.
method Simplified transformer-based attentional copulas (TACTiS) with linearly scalable parameters.
result Significantly better training dynamics and state-of-the-art performance.
We propose a calibrated multivariate regression method named CMR for fitting high dimensional multivariate regression models. Compared with existing methods, CMR calibrates regularization for each regression task with respect to its noise level so that it simultaneously attains improved finite-sample performance and tu…
Elliptical slice samplingstat.CO
Many probabilistic models introduce strong dependencies between variables using a latent multivariate Gaussian distribution or a Gaussian process. We present a new Markov chain Monte Carlo algorithm for performing inference in models with multivariate Gaussian priors. Its key properties are: 1) it has simple, generic c…
Similarity-based approaches represent a promising direction for time series analysis. However, many such methods rely on parameter tuning, and some have shortcomings if the time series are multivariate (MTS), due to dependencies between attributes, or the time series contain missing data. In this paper, we address thes…
US Yield curve has recently collapsed to its most flattened level since subprime crisis and is close to the inversion. This fact has gathered attention of investors around the world and revived the discussion of proper modeling and forecasting yield curve, since changes in interest rate structure are believed to repres…
We introduce a stochastic process with Wishart marginals: the generalised Wishart process (GWP). It is a collection of positive semi-definite random matrices indexed by any arbitrary dependent variable. We use it to model dynamic (e.g. time varying) covariance matrices. Unlike existing models, it can capture a diverse …
The paper analyzes heavy-tailed multivariate distributions in non-stationary systems using random matrix theory.
problem Risk assessment for rare events in complex, non-stationary systems.
method Generalized scalar product between correlation matrices, model for non-stationary fluctuations.
result Formulae for multivariate distributions with reduced parameters, facilitating applications.
Topological data analysis and its main method, persistent homology, provide a toolkit for computing topological information of high-dimensional and noisy data sets. Kernels for one-parameter persistent homology have been established to connect persistent homology with machine learning techniques. We contribute a kernel…
The paper examines non-Gaussian models for financial data.
problem Modeling financial data with non-Gaussian distributions.
method Analysis of multivariate non-Gaussian models focusing on parsimony, dependence structure, and computational aspects.
result Characterization and calibration of models for financial log-returns.