Parsimonious Bayesian deep networks infer optimal architectures from data.
problem Optimizing deep network architectures for efficiency and accuracy.
method Combining Bayesian nonparametrics with a greedy layer-wise learning algorithm.
result Achieves state-of-the-art classification accuracy with low computational complexity.
Investigates deep hedging under rough volatility models.
problem Performance of deep hedging framework under non-Markovian conditions.
method Analysis of rough volatility models, use of parsimonious network architectures.
result Parsimonious network architectures can capture non-Markovian time-series.
Proposes a new framework for predicting stock market movements using sparse neural architectures.
problem Challenging problem of predicting stock market movements using technical indicators.
method Multi-criteria optimization approach to evolve sparse neural architectures.
result Evolved parsimonious networks with better generalization capabilities.
Improved SINDy autoencoder for identifying noisy dynamical systems.
problem Robust identification of noisy dynamical systems from data.
method Incorporates noise-separating neural network structures into SINDy autoencoder architecture.
result Accurately recovers latent dynamics and estimates measurement noise from noisy observations.
Bayesian inference simplified for machine learning models.
problem Difficulty in specifying general prior belief in machine learning architectures.
method Parsimonious inference using information theory and Kolmogorov complexity.
result Framework quantifies model complexity and prediction information, reducing memorization.
Enhances KANs for accuracy and interpretability with multi-exit architecture.
problem Unclear optimal depth for KANs and difficulty in optimization and interpretation.
method Introduces multi-exit KANs with each layer having its own prediction branch.
result Multi-exit KANs outperform single-exit versions on various datasets.
The parsimonious Gaussian mixture models, which exploit an eigenvalue decomposition of the group covariance matrices of the Gaussian mixture, have shown their success in particular in cluster analysis. Their estimation is in general performed by maximum likelihood estimation and has also been considered from a parametr…
Parsimonious neural networks discover interpretable physical laws from data.
problem Discovering interpretable physical laws from data using machine learning.
method Combining neural networks with evolutionary optimization to balance accuracy and parsimony.
result Developed models for classical mechanics and materials melting temperature prediction.
Superior performance and ease of implementation have fostered the adoption of Convolutional Neural Networks (CNNs) for a wide array of inference and reconstruction tasks. CNNs implement three basic blocks: convolution, pooling and pointwise nonlinearity. Since the two first operations are well-defined only on regular-s…
This paper proposes a parsimoniously time varying parameter vector autoregressive model (with exogenous variables, VARX) and studies the properties of the Lasso and adaptive Lasso as estimators of this model. The parameters of the model are assumed to follow parsimonious random walks, where parsimony stems from the ass…
A parsimonious model reduces over-parameterization in skewed matrix variate mixtures.
problem Over-parameterization in skewed matrix variate mixtures.
method Parsimonious family of 256 models using bilinear factor analyzers constrained over clusters, with AECM algorithm for estimation.
result Extensive simulations and real-world datasets (MNIST, Olivetti faces) demonstrate the method's effectiveness.
Forecaster uses graph Transformers to forecast spatial and time-dependent data.
problem Complex spatial and temporal dependencies in data.
method Graph Transformer architecture with sparsification for spatial and temporal dependencies.
result Forecaster significantly outperforms state-of-the-art baselines in taxi demand forecasting.
A family of parsimonious shifted asymmetric Laplace mixture models is introduced. We extend the mixture of factor analyzers model to the shifted asymmetric Laplace distribution. Imposing constraints on the constitute parts of the resulting decomposed component scale matrices leads to a family of parsimonious models. An…
A family of parsimonious Gaussian cluster-weighted models is presented. This family concerns a multivariate extension to cluster-weighted modelling that can account for correlations between multivariate responses. Parsimony is attained by constraining parts of an eigen-decomposition imposed on the component covariance …
Improved hyperparameter optimization using simplified Transformer blocks.
problem Discovering optimal architectures in high-dimensional search spaces with limited exploration budgets.
method Simplified Transformer block for modeling hyper-parameter dependencies, actor-critic style algorithm, ensembling.
result Outperformed most algorithms on NAS-Bench-101 and Random Search in discovering more accurate model architectures.
GD-VAEs learn dynamics from observations using geometric and topological information.
problem Learning parsimonious representations of nonlinear dynamics from observations.
method Develops data-driven methods incorporating geometric and topological information using Variational Autoencoders (VAEs).
result GD-VAEs provide methods for learning reduced dimensional representations of nonlinear dynamics.
Proposes a parsimonious graph spectral method for time series data.
problem Efficiently transmitting multivariate time series data.
method Graph spectral embedding with unsupervised, parsimonious encoding.
result Near-linear computational complexity and interpretable event structure.
We propose an elementary model to price European physical delivery swaptions in multicurve setting with a simple exact closed formula. The proposed model is very parsimonious: it is a three-parameter multicurve extension of the two-parameter Hull-White (1990) model. The model allows also to obtain simple formulas for a…
Finite mixtures of regression models offer a flexible framework for investigating heterogeneity in data with functional dependencies. These models can be conveniently used for unsupervised learning on data with clear regression relationships. We extend such models by imposing an eigen-decomposition on the multivariate …
New GMM models fit high-dimensional data with fewer parameters.
problem Overparameterization and lack of flexibility in GMMs for high-dimensional data.
method Piecewise-constant covariance eigenvalue profiles, EM and penalized EM algorithms.
result Superior likelihood-parsimony tradeoffs in density fitting, clustering, and denoising.
We consider the problem of non-parametric regression with a potentially large number of covariates. We propose a convex, penalized estimation framework that is particularly well-suited for high-dimensional sparse additive models. The proposed approach combines appealing features of finite basis representation and smoot…
Bayesian context trees capture complex dependencies in categorical sequences.
problem Complex, long-range dependencies in categorical sequences are not well captured by simple models.
method Parsimonious Bayesian context trees with model-based agglomerative clustering for efficient inference.
result The proposed framework outperforms existing models on real-world data.
Proposes a non-convex optimization method for a parsimonious weighted naive Bayes classifier.
problem Improving naïve Bayes classifier performance with a large number of input variables.
method Sparse regularization of model log-likelihood for direct estimation of variable weights.
result Optimization-based weighted naïve Bayes classifiers achieve equivalent performance to averaging-based classifiers.
New algorithms improve ensemble diversity, leading to more accurate and smaller models.
problem Building accurate predictive models with diverse base predictors.
method Integrates ensemble diversity into a reinforcement learning framework for ensemble selection.
result Diversity-incorporating ensembles are more accurate and smaller in size.
GIT-Net uses neural networks to approximate PDE operators efficiently.
problem Approximating PDE operators for complex geometries.
method Parametrizes adaptive generalized integral transforms with deep neural networks.
result GIT-Net outperforms existing neural network operators in multiple areas.
Compact neural networks improve reinforcement learning performance with less data.
problem Sample inefficiency in deep reinforcement learning.
method Tensor factorization and wavelet scattering for compact representation.
result Achieved 2-10 times fewer total coefficients with comparable performance.
A new method reduces high-dimensional data's impact on CWMs using TSNE.
problem High-dimensional data hampers CWMs' accuracy and speed.
method TSNE for dimensionality reduction, parsimonious technique, expectation maximization.
result TSNE enhances CWMs' performance in high-dimensional space.
Method selects most useful network model for various tasks.
problem Impact of translating raw data to network models is unexamined.
method Proposes a network model selection methodology focusing on utility and parsimony.
result Demonstrates the importance of network definition for system behavior.
Parsimonious Dynamic Mode Decomposition selects sparse modes robustly.
problem Manual tuning of sparsity parameters in traditional DMD.
method Time-delay embedding and Orthogonal Matching Pursuit.
result Autonomously determines optimally sparse subset of modes.
A new tensor regression model preserves multidimensional data structure.
problem Complex multidimensional data loses intrinsic connections and parameter explosion.
method Developed a parsimonious tensor regression model using Tucker structure and shrinkage penalization.
result The model outperforms benchmark models in forecasting.
A new co-clustering model for high-dimensional data reduces parameter complexity.
problem High-dimensional data challenges traditional co-clustering methods.
method Parameter-wise co-clustering model with SEM and Gibbs sampler for estimation.
result The model maintains parsimony while offering more flexibility.
New multi-layer algorithm improves CNN performance.
problem Efficiently modeling and processing information with parsimonious representations.
method Generalized Basis Pursuit to multi-layer setting, proposing ML-ISTA and ML-FISTA algorithms.
result Nested first order algorithms converge to solve the multi-layer problem.
Proposes a new approach to approximate maximum likelihood for complex models.
problem Intractable likelihood functions in complex parametric models.
method Simulation-based constrained approximation to the structural model.
result Estimators nearly as efficient as maximum likelihood, feasible in many cases.
Introduces LLC, a new complexity measure for DNNs based on SLT.
problem Lack of effective complexity measures for DNNs.
method Uses Singular Learning Theory to define LLC and proposes scalable estimator.
result Empirical evidence shows LLC provides valuable insights into DNN complexity.
Optimal AFs minimize RFR test error and sensitivity.
problem Finding optimal AFs for RFR to minimize test error and sensitivity.
method Closed-form solution for AFs minimizing test error and sensitivity under different functional parsimony.
result Optimal AFs can be linear, saturated linear, or Hermite polynomial expressions.
Complex knot invariants are computationally hard.
problem Computing homomorphisms from knot groups to nonabelian simple groups.
method Using braid group actions to count homomorphisms from knot groups to nonabelian simple groups.
result Counting homomorphisms is almost parsimoniously #P-complete. Novel estimation methods improve MAR model accuracy for high-dimensional time series.
problem Limited estimation techniques for Matrix Autoregressive (MAR) models.
method Adapted Yule-Walker equations and Burg's method.
result Proposed methods achieve comparable model fit to VAR models.
New method improves traffic forecasting models by adapting to spatial shifts.
problem Improving traffic forecasting models' ability to handle spatial shifts over years.
method Proposes a novel Mixture of Experts (MoE) framework for spatiotemporal models.
result Significant improvement in performance for handling spatial distribution shifts.
New fusion blocks improve equivariant neural networks for molecular dynamics.
problem Designing equivariant neural networks for tasks with global symmetries.
method Using fusion diagrams from tensor networks to design novel equivariant components.
result Improved performance with fewer parameters on chemical problems.
Bayesian method reconstructs hidden higher-order interactions from network data.
problem Lack of explicit higher-order interactions in pairwise network data.
method Bayesian approach based on parsimony, infers higher-order structures when statistically supported.
result Demonstrated applicability to various datasets, synthetic and empirical.
Recent years have demonstrated that using random feature maps can significantly decrease the training and testing times of kernel-based algorithms without significantly lowering their accuracy. Regrettably, because random features are target-agnostic, typically thousands of such features are necessary to achieve accept…
GANs can approximate SDEs for large time steps.
problem Approximating SDEs for large time steps using GANs.
method Proposed a conditional GAN architecture to enable strong approximation of SDEs.
result Supervised GAN outperformed standard GAN and other schemes in strong error.
Researchers develop multi-utility representations for incomplete preferences linked to risk measures.
problem Handling incomplete preferences induced by set-valued risk measures.
method Established dual representations of set-valued risk measures to create parsimonious and well-behaved multi-utility representations.
result Unified dual representations of set-valued risk measures, linking them to scalar risk measures.
For a long time interest-rate models were built on a single yield curve used both for discounting and forwarding. However, the crisis that has affected financial markets in the last years led market players to revise this assumption and accommodate basis-swap spreads, whose remarkable widening can no longer be neglecte…
Deep neural network generates symbolic equations from data.
problem Lack of insight into underlying mappings from traditional deep learning.
method Combines deep learning flexibility with symbolic solutions.
result Accurately generates governing equations for dynamical systems.
To model high dimensional data, Gaussian methods are widely used since they remain tractable and yield parsimonious models by imposing strong assumptions on the data. Vine copulas are more flexible by combining arbitrary marginal distributions and (conditional) bivariate copulas. Yet, this adaptability is accompanied b…
PASTIS method selects simple models from noisy data.
problem Selecting correct models from large candidate libraries.
method PASTIS (Parsimonious Stochastic Inference) using extreme value theory.
result PASTIS outperforms other methods in model identification and predictive capability.
The problem to accurately and parsimoniously characterize random series of events (RSEs) present in the Web, such as e-mail conversations or Twitter hashtags, is not trivial. Reports found in the literature reveal two apparent conflicting visions of how RSEs should be modeled. From one side, the Poissonian processes, o…