The parsimonious Gaussian mixture models, which exploit an eigenvalue decomposition of the group covariance matrices of the Gaussian mixture, have shown their success in particular in cluster analysis. Their estimation is in general performed by maximum likelihood estimation and has also been considered from a parametr…
Parsimonious neural networks discover interpretable physical laws from data.
problem Discovering interpretable physical laws from data using machine learning.
method Combining neural networks with evolutionary optimization to balance accuracy and parsimony.
result Developed models for classical mechanics and materials melting temperature prediction.
This paper proposes a parsimoniously time varying parameter vector autoregressive model (with exogenous variables, VARX) and studies the properties of the Lasso and adaptive Lasso as estimators of this model. The parameters of the model are assumed to follow parsimonious random walks, where parsimony stems from the ass…
Simple model prices swaptions in multicurve interest rates.
problem Pricing swaptions in multicurve interest rate models.
method Three-parameter multicurve extension of Hull-White model.
result Simple closed formula for swaption pricing.
A parsimonious model reduces over-parameterization in skewed matrix variate mixtures.
problem Over-parameterization in skewed matrix variate mixtures.
method Parsimonious family of 256 models using bilinear factor analyzers constrained over clusters, with AECM algorithm for estimation.
result Extensive simulations and real-world datasets (MNIST, Olivetti faces) demonstrate the method's effectiveness.
A family of parsimonious shifted asymmetric Laplace mixture models is introduced. We extend the mixture of factor analyzers model to the shifted asymmetric Laplace distribution. Imposing constraints on the constitute parts of the resulting decomposed component scale matrices leads to a family of parsimonious models. An…
A family of parsimonious Gaussian cluster-weighted models is presented. This family concerns a multivariate extension to cluster-weighted modelling that can account for correlations between multivariate responses. Parsimony is attained by constraining parts of an eigen-decomposition imposed on the component covariance …
Parsimonious Bayesian deep networks infer optimal architectures from data.
problem Optimizing deep network architectures for efficiency and accuracy.
method Combining Bayesian nonparametrics with a greedy layer-wise learning algorithm.
result Achieves state-of-the-art classification accuracy with low computational complexity.
Proposes a parsimonious graph spectral method for time series data.
problem Efficiently transmitting multivariate time series data.
method Graph spectral embedding with unsupervised, parsimonious encoding.
result Near-linear computational complexity and interpretable event structure.
Finite mixtures of regression models offer a flexible framework for investigating heterogeneity in data with functional dependencies. These models can be conveniently used for unsupervised learning on data with clear regression relationships. We extend such models by imposing an eigen-decomposition on the multivariate …
New GMM models fit high-dimensional data with fewer parameters.
problem Overparameterization and lack of flexibility in GMMs for high-dimensional data.
method Piecewise-constant covariance eigenvalue profiles, EM and penalized EM algorithms.
result Superior likelihood-parsimony tradeoffs in density fitting, clustering, and denoising.
Bayesian context trees capture complex dependencies in categorical sequences.
problem Complex, long-range dependencies in categorical sequences are not well captured by simple models.
method Parsimonious Bayesian context trees with model-based agglomerative clustering for efficient inference.
result The proposed framework outperforms existing models on real-world data.
Investigates deep hedging under rough volatility models.
problem Performance of deep hedging framework under non-Markovian conditions.
method Analysis of rough volatility models, use of parsimonious network architectures.
result Parsimonious network architectures can capture non-Markovian time-series.
Proposes a non-convex optimization method for a parsimonious weighted naive Bayes classifier.
problem Improving naïve Bayes classifier performance with a large number of input variables.
method Sparse regularization of model log-likelihood for direct estimation of variable weights.
result Optimization-based weighted naïve Bayes classifiers achieve equivalent performance to averaging-based classifiers.
New algorithms improve ensemble diversity, leading to more accurate and smaller models.
problem Building accurate predictive models with diverse base predictors.
method Integrates ensemble diversity into a reinforcement learning framework for ensemble selection.
result Diversity-incorporating ensembles are more accurate and smaller in size.
Method selects most useful network model for various tasks.
problem Impact of translating raw data to network models is unexamined.
method Proposes a network model selection methodology focusing on utility and parsimony.
result Demonstrates the importance of network definition for system behavior.
A new method reduces high-dimensional data's impact on CWMs using TSNE.
problem High-dimensional data hampers CWMs' accuracy and speed.
method TSNE for dimensionality reduction, parsimonious technique, expectation maximization.
result TSNE enhances CWMs' performance in high-dimensional space.
We consider the problem of non-parametric regression with a potentially large number of covariates. We propose a convex, penalized estimation framework that is particularly well-suited for high-dimensional sparse additive models. The proposed approach combines appealing features of finite basis representation and smoot…
A new tensor regression model preserves multidimensional data structure.
problem Complex multidimensional data loses intrinsic connections and parameter explosion.
method Developed a parsimonious tensor regression model using Tucker structure and shrinkage penalization.
result The model outperforms benchmark models in forecasting.
A new method limits over-clustering in DPM models.
problem Over-clustering in Dirichlet process mixture models.
method Powered Chinese restaurant process to penalize over-clustering.
result Reduces the number of clusters in large datasets.
Proposes a new approach to approximate maximum likelihood for complex models.
problem Intractable likelihood functions in complex parametric models.
method Simulation-based constrained approximation to the structural model.
result Estimators nearly as efficient as maximum likelihood, feasible in many cases.
A new co-clustering model for high-dimensional data reduces parameter complexity.
problem High-dimensional data challenges traditional co-clustering methods.
method Parameter-wise co-clustering model with SEM and Gibbs sampler for estimation.
result The model maintains parsimony while offering more flexibility.
Novel estimation methods improve MAR model accuracy for high-dimensional time series.
problem Limited estimation techniques for Matrix Autoregressive (MAR) models.
method Adapted Yule-Walker equations and Burg's method.
result Proposed methods achieve comparable model fit to VAR models.
Optimal AFs minimize RFR test error and sensitivity.
problem Finding optimal AFs for RFR to minimize test error and sensitivity.
method Closed-form solution for AFs minimizing test error and sensitivity under different functional parsimony.
result Optimal AFs can be linear, saturated linear, or Hermite polynomial expressions.
For a long time interest-rate models were built on a single yield curve used both for discounting and forwarding. However, the crisis that has affected financial markets in the last years led market players to revise this assumption and accommodate basis-swap spreads, whose remarkable widening can no longer be neglecte…
PASTIS method selects simple models from noisy data.
problem Selecting correct models from large candidate libraries.
method PASTIS (Parsimonious Stochastic Inference) using extreme value theory.
result PASTIS outperforms other methods in model identification and predictive capability.
Model for valuing options on epidemic spread.
problem Valuation of options on epidemic spread during an outbreak.
method Stochastic differential SIR model for epidemic dynamics.
result Parsimonious model for option valuation on epidemic spread.
Parsimonious Dynamic Mode Decomposition selects sparse modes robustly.
problem Manual tuning of sparsity parameters in traditional DMD.
method Time-delay embedding and Orthogonal Matching Pursuit.
result Autonomously determines optimally sparse subset of modes.
The problem to accurately and parsimoniously characterize random series of events (RSEs) present in the Web, such as e-mail conversations or Twitter hashtags, is not trivial. Reports found in the literature reveal two apparent conflicting visions of how RSEs should be modeled. From one side, the Poissonian processes, o…
We consider the problem of modeling multivariate time series with parsimonious dynamical models which can be represented as sparse dynamic Bayesian networks with few latent nodes. This structure translates into a sparse plus low rank model. In this paper, we propose a Gaussian regression approach to identify such a mod…
A new model captures financial asset returns' tail behaviors and outperforms GARCH family.
problem Capturing the dynamic tail behaviors of financial asset returns.
method Combines LSTM with a novel parametric quantile function.
result Out-of-sample forecasts of conditional quantiles or VaR outperform GARCH family.
Paper models ultra-high dimensional data using Gaussian and vine copulas.
problem Modeling ultra-high dimensional non-Gaussian data.
method Divide-and-conquer approach: Gaussian methods for subsets, vine copulas for reconciled model.
result Feasibility and estimation in thousands of dimensions demonstrated.
Recent years have demonstrated that using random feature maps can significantly decrease the training and testing times of kernel-based algorithms without significantly lowering their accuracy. Regrettably, because random features are target-agnostic, typically thousands of such features are necessary to achieve accept…
Kolmogorov-Arnold Networks offer improved interpretability and parsimony in science tasks.
problem Improving interpretability and parsimony in science-oriented tasks.
method Theoretical analysis of Kolmogorov-Arnold Networks (KAN) with generalization bounds and model complexity.
result Generalization bounds for KAN with various activation functions, scaling with the l1 norm of coefficient matrices and Lipschitz constants. We propose a parsimonious topic model for text corpora. In related models such as Latent Dirichlet Allocation (LDA), all words are modeled topic-specifically, even though many words occur with similar frequencies across different topics. Our modeling determines salient words for each topic, which have topic-specific pr…
Paper discovers structural dynamics equations from only acceleration data.
problem Discovering equations from only acceleration measurements in structural dynamics.
method Library-based approach with Approximate Bayesian Computation (ABC) prioritizing parsimonious models.
result Efficacy demonstrated in four structural dynamics examples, including linear and nonlinear systems.
Variable selection for high-dimensional linear models has received a lot of attention lately, mostly in the context of l1-regularization. Part of the attraction is the variable selection effect: parsimonious models are obtained, which are very suitable for interpretation. In terms of predictive power, however, these re…
The goal of this paper is to assess the utility of Reduced-Order Models (ROMs) developed from 3D physics-based models for predicting transient thermal power output for an enhanced geothermal reservoir while explicitly accounting for uncertainties in the subsurface system and site-specific details. Numerical simulations…
Proposes I-prior extension for additive interaction models.
problem Challenges in estimating and selecting models with interactions.
method Extends I-prior methodology to multiple covariates, introducing a parsimonious model specification.
result Improves estimation and model selection for additive interaction models.
Rectangular Bounding Process (RBP) improves partitioning efficiency in multi-dimensional spaces.
problem Creating many unnecessary divisions in sparse regions when describing dense regions.
method Introduces Rectangular Bounding Process (RBP) to efficiently partition multi-dimensional spaces using a bounding strategy.
result The RBP is self-consistent and can be extended to infinite space, offering rich yet parsimonious expressiveness.
New method fits sparse Markov models to categorical time series using convex clustering.
problem Exponentially growing parameters in higher-order Markov chains.
method Convex clustering and regularization for parsimonious modeling.
result Theoretical consistency and finite sample performance demonstrated.
A stochastic model for pure-jump diffusion (the compound renewal process) can be used as a zero-order approximation and as a phenomenological description of tick-by-tick price fluctuations. This leads to an exact and explicit general formula for the martingale price of a European call option. A complete derivation of t…
We investigate LIBOR-based derivatives using a parsimonious field theory interest rate model capable of instilling imperfect correlation between different maturities. Delta and Gamma hedge parameters are derived for LIBOR Caps against fluctuations in underlying forward rates. An empirical illustration of our methodolog…
Paper addresses unbalanced data in common shock models for loss reserving.
problem Complications in capturing structural dependence with unbalanced data.
method Introduces a common shock Tweedie approach for unbalanced data.
result Better balance of common shock proportions and parsimonious solution.
Proposes MorphMine for unsupervised morpheme segmentation to improve word embeddings.
problem Lack of semantic information in word-level analysis for infrequent and out-of-vocabulary words.
method MorphMine applies a parsimony criterion to hierarchically segment words into the fewest number of morphemes.
result MorphMine segments words into human-verified morphemes and improves word embedding quality.
Enhances KANs for accuracy and interpretability with multi-exit architecture.
problem Unclear optimal depth for KANs and difficulty in optimization and interpretation.
method Introduces multi-exit KANs with each layer having its own prediction branch.
result Multi-exit KANs outperform single-exit versions on various datasets.
Improved SINDy autoencoder for identifying noisy dynamical systems.
problem Robust identification of noisy dynamical systems from data.
method Incorporates noise-separating neural network structures into SINDy autoencoder architecture.
result Accurately recovers latent dynamics and estimates measurement noise from noisy observations.
Complex knot invariants are computationally hard.
problem Computing homomorphisms from knot groups to nonabelian simple groups.
method Using braid group actions to count homomorphisms from knot groups to nonabelian simple groups.
result Counting homomorphisms is almost parsimoniously #P-complete.