NanoFlow reduces parameter complexity in normalizing flows.
problem Efficient parameter complexity in flow-based models.
method Single neural density estimator with flow indication embedding.
result Sublinear parameter complexity achieved.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “Parameter Complexity”
Maxout networks show similar complexity issues as ReLU networks.
problem Understanding the complexity of maxout networks and decision boundaries.
method Analyzing the parameter space and decision boundaries, obtaining lower bounds, and investigating initialization procedures.
result Maxout networks exhibit a wide range of complexity, similar to ReLU networks.
Develops black-box methods to estimate parameters of complex models.
problem Lack of efficient methods to produce simulations for complex statistical models.
method Pre-training deep neural networks on extensive simulated databases for well-structured likelihoods. Iterative algorithm for other complex dependencies.
result Successfully estimates and quantifies uncertainty of parameters from non-Gaussian models.
Random complexes can be embedded linearly if certain conditions on parameters are met.
problem Embedding random simplicial complexes linearly in Euclidean space.
method Established strict inequalities on parameters for linear embedding into R^(2d).
result Necessary and sufficient conditions for linear embedding of random complexes.
The study determines discreteness of complex hyperbolic triangle groups.
problem Discreteness of complex hyperbolic triangle groups of specific type.
method Analysis of groups generated by complex reflections with given orders and distances.
result Determined intervals in parameter space for discrete and non-discrete groups.
New combinatorial framework for geometric realizations of subword complexes.
problem Proving or disproving geometric realizations of subword complexes of Coxeter groups.
method Algebraic combinatorics and discrete geometry framework, parameter matrices.
result Existence of parameter matrices equivalent to realizability of subword complexes as chirotopes.
Paper constructs Thom-Smale complex using instantons from Morse functions.
problem Constructing Thom-Smale complex for Morse functions.
method Analytic instanton construction using eigenspaces of mapping cone Laplacian.
result Instanton complex is cochain isomorphic to Thom-Smale complex.
Study shows sample complexity for logistic regression with normal covariates.
problem Estimating parameters of logistic regression with normal design.
method Analyzes sample complexity in terms of dimension and inverse temperature.
result Shows two change-points in sample complexity curve based on inverse temperature.
New phases identified in neural scaling laws with compute limits.
problem Understanding neural scaling laws under compute constraints.
method Solved neural scaling model with stochastic gradient descent, derived loss curves, analyzed model-parameter-count phases.
result Identified 4 phases (+3 subphases) in data-complexity/target-complexity phase-plane, derived exponents.
MuRiT efficiently computes multi-parameter persistence barcodes.
problem Efficient computation of multi-parameter persistent homology.
method Vietoris-Rips transformation to reduce multi-parameter to single-parameter computation.
result MuRiT computes pathwise persistence barcodes for multi-filtered flag complexes.
Efficient algorithms for sparse parameter recovery in mixture models.
problem Support recovery of high-dimensional sparse latent vectors in mixture models.
method Efficient algorithms with logarithmic sample complexity dependence on dimensionality.
result First guarantees on support recovery for various mixture models.
In \cite{Mul} one-parameter planar motion was first introduced and the relations between absolute, relative, sliding velocities (and accelerations) in the Euclidean plane were obtained. Moreover, the relations between the Complex velocities one-parameter motion in the Complex plane were provided by \cite…
In this paper we study discreteness of complex hyperbolic triangle groups of type , i.e. groups of isometries of the complex hyperbolic plane generated by three complex reflections of orders in complex geodesics with pairwise distances . For fixed the parameter space of such groups is…
Develops 2-categorical methods for multi-parameter persistence.
problem Fundamental limitations of traditional persistence modules.
method 2-categorical structures to capture hierarchical interactions.
result New invariants effectively characterize multidimensional topological features.
Method estimates parameters of complex nonlinear systems.
problem Parameter estimation for nonlinear systems with derivative states.
method Regularized linear regression using differentiation filtering and least squares.
result Finite-sample bound on mean absolute error of estimation.
In the current article we study complex cycles of higher multiplicity in a specific polynomial family of holomorphic foliations in the complex plane. The family in question is a perturbation of an exact polynomial one-form giving rise to a foliation by Riemann surfaces. In this setting, a complex cycle is defined as a …
Study on colored Jones polynomial of figure-eight knot for complex parameters.
problem Asymptotic behavior of colored Jones polynomial for figure-eight knot.
method Analyzing the asymptotic growth rate of the polynomial for complex parameters with small imaginary part.
result Growth rate of polynomial is related to the Chern-Simons invariant for large real part of the parameter and to the reciprocal of Alexander polynomial for small real part.
New method improves parameter estimation in complex stochastic models.
problem Parameter calibration in stochastic models with unavailable analytical likelihood.
method Gradient-based simulated parameter estimation with multi-time scale stochastic approximation.
result Enhanced estimation accuracy and reduced computational costs.
Optimal ReLU networks can memorize any separable set of points with a small number of parameters.
problem The optimal number of parameters required to memorize a set of points using ReLU networks.
method Construction of ReLU networks with specific bit complexity to memorize points satisfying a mild separability assumption.
result Optimal ReLU networks can memorize any separable set of points with a number of parameters that is .
New algorithm detects changes quickly without knowing parameters, near optimally.
problem Quickest change detection with unknown parameters.
method Leverages theoretical asymptotic properties to derive a scalable approximate algorithm with near optimal performance.
result Detects changes in constant complexity with near optimal performance.
The purpose of this article is to classify the real hypersurfaces in complex space forms of dimension 2 that are both Levi-flat and minimal. The main results are as follows: When the curvature of the complex space form is nonzero, there is a 1-parameter family of such hypersurfaces. Specifically, for each one-parameter…
Sliced Inverse Regression reduces parameter space for estimating complex financial models.
problem High-dimensional parameter space in stochastic differential equations.
method Sliced Inverse Regression for dimension reduction.
result Reduced computational costs in estimating parameters.
A new method reduces complexity and uncertainty in neural networks.
problem Uncertainty quantification in complex neural networks.
method Condensed Stein Variational Gradient Descent (cSVGD) method.
result Condensed SVGD provides uncertainty quantification on parameters.
Efficient algorithms improve learning of large-margin halfspaces.
problem Learning large-margin halfspaces efficiently and reproducibly.
method Design of efficient, dimension-independent, polynomial-time algorithms; SGD-based approach; DP-to-Replicability reduction.
result Improved sample complexity compared to previous algorithms, with optimal sample complexity for one algorithm.
Spherical arc-length as a global conformal parameter for analytic curves in the Riemann spheremath.CV
We prove that for every analytic curve in the complex plane, Euclidean and spherical arc-lengths are global conformal parameters. We also prove that for any analytic curve in the hyperbolic plane, hyperbolic arc-length is also a global parameter. We generalize some of these results to the case of analytic curves in Euc…
New method for efficient inference over complex parameter spaces.
problem Challenges in Bayesian inference for high-dimensional, intractable likelihoods.
method Arbitrary Marginal Neural Ratio Estimation (AMNRE) for simulation-based inference.
result Efficient inference over arbitrary subsets of parameters without numerical integration.
The Mallows model, introduced in the seminal paper of Mallows 1957, is one of the most fundamental ranking distribution over the symmetric group . To analyze more complex ranking data, several studies considered the Generalized Mallows model defined by Fligner and Verducci 1986. Despite the significant research in…
Far from Asymptopiastat.OT
New optimal prior avoids bias in complex models with limited data.
problem Bias in inference from limited data using Jeffreys prior.
method Developed a principled choice of measure that avoids bias, dependent on data quantity.
result Optimal prior leads to unbiased inference in complex models.
Bayesian parameter estimation of miss-specified modelsphysics.data-an
Fitting a simplifying model with several parameters to real data of complex objects is a highly nontrivial task, but enables the possibility to get insights into the objects physics. Here, we present a method to infer the parameters of the model, the model error as well as the statistics of the model error. This method…
Why do deep neural networks (DNNs) benefit from very high dimensional parameter spaces? Their huge parameter complexities vs stunning performance in practice is all the more intriguing and not explainable using the standard theory of model selection for regular models. In this work, we propose a geometrically flavored …
Cross-regularization adapts model complexity during training.
problem Manual tuning of model complexity for overfitting prevention.
method Directly adapts regularization parameters through validation gradients during training.
result Organic emergence of architecture-specific regularization during training.
A new method estimates parameters of complex models using ordinary least squares.
problem Estimating parameters of nonlinear dynamic models from time series data.
method Physics-Informed Regression (PIR) using regularized ordinary least squares.
result PIR outperforms physics-informed neural networks (PINN) in parameter estimation.
Researchers prove NP-hardness of learning parameter-bounded Bayes nets.
problem Learning parameter-bounded Bayes nets is computationally hard.
method Proved NP-hardness of learning parameter-bounded Bayes nets and a promise search variant.
result Proved NP-hardness of a promise search variant of LEARN.
Let be a group acting properly and by isometries on a metric space ; it follows that the quotient or orbit space is also a metric space. We study the Vietoris-Rips and Čech complexes of . Whereas (co)homology theories for metric spaces let the scale parameter of a Vietoris-Rips or Čech complex go to z…
We propose reinforcement learning on simple networks consisting of random connections of spiking neurons (both recurrent and feed-forward) that can learn complex tasks with very little trainable parameters. Such sparse and randomly interconnected recurrent spiking networks exhibit highly non-linear dynamics that transf…
Improved sample complexity for Gaussian Mixture Models using Pair Correlation Factor.
problem Understanding the sample complexity of Gaussian Mixture Models.
method Introducing Pair Correlation Factor (PCF) to measure clustering of component means and improving sample complexity bounds.
result The Pair Correlation Factor (PCF) more accurately determines the difficulty of parameter recovery in Gaussian Mixture Models.
New insights into neural network complexity reveal better generalization performance.
problem Mysterious generalization in deep models despite high parameter counts.
method Effective dimensionality as a measure of parameter space complexity.
result Double descent behavior in generalization as a function of parameters explained.
A novel stepwise VI method using vine copulas for complex latent dependence.
problem Modeling complex latent dependence structures in probabilistic models.
method Stepwise estimation of vine copula parameters using Rényi divergence and a stopping criterion.
result Our method outperforms mean-field VI and is more parsimonious in complex applications.
GeneCAI optimizes DNN compression hyper-parameters for mobile devices.
problem Efficient deployment of complex DNNs on resource-limited devices.
method GeneCAI uses genetic algorithm to learn optimal hyper-parameters.
result GeneCAI finds models with better accuracy-complexity trade-off.
For a variety of regularized optimization problems in machine learning, algorithms computing the entire solution path have been developed recently. Most of these methods are quadratic programs that are parameterized by a single parameter, as for example the Support Vector Machine (SVM). Solution path algorithms do not …
Determining how to appropriately select the tuning parameter is essential in penalized likelihood methods for high-dimensional data analysis. We examine this problem in the setting of penalized likelihood methods for generalized linear models, where the dimensionality of covariates p is allowed to increase exponentiall…
Optimizes learning policies in average-reward MDPs with improved sample complexity.
problem Learning optimal policies in average-reward MDPs with limited samples.
method Reduces to discounted MDPs and uses improved bounds for variance parameters.
result Establishes minimax optimal sample complexity bound of O(SA(H/ε^2))
Efficient CNN-LSTM based Parameter Estimation of Levy Driven Stochastic Differential Equationsstat.ML
Study improves parameter estimation for SDEs driven by Levy noise.
problem Challenges in estimating parameters of SDEs with non-Gaussian noises.
method Introduces PEnet, a CNN-LSTM model for efficient parameter estimation.
result PEnet offers superior accuracy and adaptability for various SDE scenarios.
Fast algorithms for learning a Gaussian under halfspace truncation with optimal sample complexitycs.DS
Optimal algorithm learns Gaussian under halfspace truncation with minimal samples.
problem Learning a Gaussian distribution truncated to an unknown halfspace.
method Efficient algorithm using samples and runtime dominated by empirical covariance matrix computation.
result Optimal sample and time complexity bounds for learning a Gaussian under halfspace truncation.
Adapts MBDOE for real-time parameter estimation in complex systems.
problem Costly posterior inference and design optimization in nonlinear systems.
method Combines DAD with differentiable mechanistic models for real-time parameter estimation.
result Demonstrated on four systems, including a DC motor.
Discovering state-parameter mappings in subsurface models using generative adversarial networksphysics.data-an
A fundamental problem in geophysical modeling is related to the identification and approximation of causal structures among physical processes. However, resolving the bidirectional mappings between physical parameters and model state variables (i.e., solving the forward and inverse problems) is challenging, especially …
Black-box optimizers that explore in parameter space have often been shown to outperform more sophisticated action space exploration methods developed specifically for the reinforcement learning problem. We examine these black-box methods closely to identify situations in which they are worse than action space explorat…
NSGD-M optimizes machine learning models without hyperparameter tuning, even under relaxed smoothness.
problem Training machine learning models with optimal complexity under relaxed smoothness assumptions.
method Normalized Stochastic Gradient Descent with Momentum (NSGD-M) without stepsize tuning.
result NSGD-M achieves nearly optimal complexity without prior knowledge of problem parameters.