We develop a more efficient NGD method for structured parameters.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Improved Bayesian optimization for conditional parameter spaces.
We consider multi-response and multitask regression models, where the parameter matrix to be estimated is expected to have an unknown grouping structure. The groupings can be along tasks, or features, or both, the last one indicating a bi-cluster or "checkerboard" structure. Discovering this grouping structure along wi…
A new method infers graph structure and parameters using a single generative flow network.
A non-elementary Möbius group generated by two-parabolics is determined up to conjugation by one complex parameter and the parameter space has been extensively studied. In this paper, we use the results of \cite{GW} to obtain an additional structure for the parameter space, which we term the {\sl two-parabolic space}. …
Develops methods for constructing likelihoods and priors for Bayesian networks.
Bayesian scores improve structure learning in probabilistic circuits.
Bayesian neural networks learn graph structure with interpretable parameters.
Unified framework improves option pricing accuracy and stability.
New neural network approach for optimizing latent variable models.
BDeu marginal likelihood score is a popular model selection criterion for selecting a Bayesian network structure based on sample data. This non-informative scoring criterion assigns same score for network structures that encode same independence statements. However, before applying the BDeu score, one must determine a …
Library learns Bayesian networks from mixed data without discretization.
Constructs Lorentzian manifolds from Riemannian conformal structures.
The Random Parameters model was proposed to explain the structure of the covariance matrix in problems where most, but not all, of the eigenvalues of the covariance matrix can be explained by Random Matrix Theory. In this article, we explore other properties of the model, like the scaling of its PDF as one take larger …
In practical Bayesian optimization, we must often search over structures with differing numbers of parameters. For instance, we may wish to search over neural network architectures with an unknown number of layers. To relate performance data gathered for different architectures, we define a new kernel for conditional p…
Singularities of a statistical model are the elements of the model's parameter space which make the corresponding Fisher information matrix degenerate. These are the points for which estimation techniques such as the maximum likelihood estimator and standard Bayesian procedures do not admit the root- parametric rate…
In recent years a number of methods have been developed for automatically learning the (sparse) connectivity structure of Markov Random Fields. These methods are mostly based on L1-regularized optimization which has a number of disadvantages such as the inability to assess model uncertainty and expensive crossvalidatio…
In recent years a number of methods have been developed for automatically learning the (sparse) connectivity structure of Markov Random Fields. These methods are mostly based on L1-regularized optimization which has a number of disadvantages such as the inability to assess model uncertainty and expensive cross-validati…
We consider learning high-dimensional multi-response linear models with structured parameters. By exploiting the noise correlations among responses, we propose an alternating estimation (AltEst) procedure to estimate the model parameters based on the generalized Dantzig selector. Under suitable sample size and resampli…
Approach uses machine learning to identify structural modal parameters from output-only data.
Efficiently models learning curves using Gaussian processes with latent Kronecker structure.
New method identifies causal parameters in tree-shaped linear models using cycles.
Found a new compact G2-structure on a 7-manifold.
Unsupervised pretraining and dropout have been well studied, especially with respect to regularization and output consistency. However, our understanding about the explicit convergence rates of the parameter estimates, and their dependence on the learning (like denoising and dropout rate) and structural (like depth and…
A new framework for structured bandits using influence diagrams and variational Thompson sampling.
Study analyzes convergence of parameter estimation in contaminated mixture of experts.
Algorithms typically come with tunable parameters that have a considerable impact on the computational resources they consume. Too often, practitioners must hand-tune the parameters, a tedious and error-prone task. A recent line of research provides algorithms that return nearly-optimal parameters from within a finite …
Embeds sparsity in deep neural networks, allowing exact zero parameters.
Several convex formulation methods have been proposed previously for statistical estimation with structured sparsity as the prior. These methods often require a carefully tuned regularization parameter, often a cumbersome or heuristic exercise. Furthermore, the estimate that these methods produce might not belong to th…
The paper finds a unique curve minimizing Loewner energy among piecewise geodesic Jordan curves.
The paper develops scalable variational inference for Bayesian neural networks under model and parameter uncertainty.
Paper analyzes GMM for separable data with various parameter structures.
Novel covariance function improves Bayesian optimization efficiency.
Mathematical models with time dependent parameters are of great interest in financial Mathematics because they capture real life scenarios in the financial market. In this study, via the Lie group technique, we analyse evolution-type equations with time dependent parameters and give the general symmetry structure of th…
The focus in this paper is Bayesian system identification based on noisy incomplete modal data where we can impose spatially-sparse stiffness changes when updating a structural model. To this end, based on a similar hierarchical sparse Bayesian learning model from our previous work, we propose two Gibbs sampling algori…
New multigrid approach reduces CNN parameters by focusing on structured convolutions.
CNNs use a bottleneck structure to focus on a few frequencies, affecting function representation.
Improved text generation with discourse-aware soft prompts.
Current methods for learning graphical models with latent variables and a fixed structure estimate optimal values for the model parameters. Whereas this approach usually produces overfitting and suboptimal generalization performance, carrying out the Bayesian program of computing the full posterior distributions over t…
In high-dimensional and/or non-parametric regression problems, regularization (or penalization) is used to control model complexity and induce desired structure. Each penalty has a weight parameter that indicates how strongly the structure corresponding to that penalty should be enforced. Typically the parameters are c…
The paper studies dynamical systems with evolving geometric structure using numerical methods.
Modern deep neural networks are typically highly overparameterized. Pruning techniques are able to remove a significant fraction of network parameters with little loss in accuracy. Recently, techniques based on dynamic reallocation of non-zero parameters have emerged, allowing direct training of sparse networks without…
Continuous time Bayesian networks (CTBNs) describe structured stochastic processes with finitely many states that evolve over continuous time. A CTBN is a directed (possibly cyclic) dependency graph over a set of variables, each of which represents a finite state continuous time Markov process whose transition model is…
Bandit learning algorithms typically involve the balance of exploration and exploitation. However, in many practical applications, worst-case scenarios needing systematic exploration are seldom encountered. In this work, we consider a smoothed setting for structured linear contextual bandits where the adversarial conte…
Develops black-box methods to estimate parameters of complex models.
Express Wavenet is an improved optical diffractive neural network. At each layer, it uses wavelet-like pattern to modulate the phase of optical waves. For input image with n2 pixels, express wavenet reduce parameter number from O(n2) to O(n). Only need one percent of the parameters, and the accuracy is still very high.…
Paper efficiently infers differential parameters in time-varying models using time score matching.
Let M be a six dimensional manifold, endowed with a cohomogeneity one action of G= SU_2 x SU_2, and M_reg its subset of regular points. We show that M_reg admits a smooth, 2-parameter family of G-invariant, non-isometric strict nearly Kaehler structures and that a 1-parameter subfamily of such structures smoothly exten…