Derives log-corrections in AdS4/CFT3 using supergravity localization.
problem Factorizing log-corrections in AdS4/CFT3.
method Supergravity localization, Atiyah-Singer index theorem, fixed points (NUTs), fixed two-manifolds (Bolts).
result General fixed-point formula for log-corrections in large N expansion.
Corrects GCV for inconsistent risk estimation in finite ensembles of penalized estimators.
problem Inconsistent risk estimation of GCV for finite ensembles of penalized estimators.
method Identifies a correction involving an additional scalar correction based on degrees of freedom adjusted training errors from each ensemble component.
result CGCV maintains computational advantages of GCV and is model-free uniformly consistent for ridge regression.
Measures neural network complexity via effective degrees of freedom.
problem Challenges in quantifying neural network complexity.
method Adapts generalized degrees of freedom (GDF) for binary outcomes and compares with cross-validation and null degrees of freedom.
result GDF provides a robust measure of model complexity for neural networks.
Paper addresses hypothesis space misspecification in learning from human demonstrations and corrections.
problem Hypothesis space misspecification in learning from human demonstrations and corrections.
method Reason explicitly about how well the robot can explain human inputs given its hypothesis space.
result Demonstrates method on a 7 DOF robot manipulator.
In this paper, we explore degrees of freedom in deep sigmoidal neural networks. We show that the degrees of freedom in these models is related to the expected optimism, which is the expected difference between test error and training error. We provide an efficient Monte-Carlo method to estimate the degrees of freedom f…
Ray-Singer torsion measures light degrees of freedom in black hole entropy.
problem Entropy of small black holes with many light particles.
method Computes partition function at genus one using mirror symmetry and Ray-Singer torsion.
result Ray-Singer torsion provides an effective quantum gravity cutoff known as the species scale.
The Lasso method is analyzed for high-dimensional regression with Gaussian designs, leading to new insights on its performance.
problem Analyzing the Lasso method for high-dimensional regression with Gaussian designs.
method Generalizing the Lasso characterization to Gaussian correlated designs with non-singular covariance structure.
result Establishing non-asymptotic bounds on the distance between the distribution of various quantities in the two models.
The derivation of statistical properties for Partial Least Squares regression can be a challenging task. The reason is that the construction of latent components from the predictor variables also depends on the response variable. While this typically leads to good performance and interpretable models in practice, it ma…
This paper investigates the model degrees of freedom in k-means clustering. An extension of Stein's lemma provides an expression for the effective degrees of freedom in the k-means model. Approximating the degrees of freedom in practice requires simplifications of this expression, however empirical studies evince the a…
Regularization aims to improve prediction performance of a given statistical modeling approach by moving to a second approach which achieves worse training error but is expected to have fewer degrees of freedom, i.e., better agreement between training and prediction error. We show here, however, that this expected beha…
A new distribution family extends the α-stable distribution with a degree of freedom parameter.
problem Lack of moments in the α-stable distribution. method Wright function framework to combine and extend distribution families.
result Generalized α-stable distribution with valid moments. Atoms and molecules are important conceptual entities we invented to understand the physical world around us. The key to their usefulness lies in the organization of nuclear and electronic degrees of freedom into a single dynamical variable whose time evolution we can better imagine. The use of such effective variables…
Study 3d N=1 vacua from M-theory compactification on Spin(7) space.
problem Quantum corrections in 3d N=1 vacua from M-theory compactification.
method Use Higgs bundles to analyze 3d N=1 vacua and track corrections.
result Topological anomalies are robust and calculable in 3d effective field theory.
Estimating fundamental matrices is a classic problem in computer vision. Traditional methods rely heavily on the correctness of estimated key-point correspondences, which can be noisy and unreliable. As a result, it is difficult for these methods to handle image pairs with large occlusion or significantly different cam…
Unified finetuning of all quantization degrees of freedom achieves state-of-the-art 4-bit quantization.
problem Achieving high accuracy in quantized neural networks while maintaining speed and resource constraints.
method Quantization-aware finetuning (QFT) that jointly optimizes all quantization degrees of freedom.
result 4-bit weight quantization results on-par with state-of-the-art (SoTA) within PTQ constraints.
Maximum Likelihood Estimation (MLE) is the bread and butter of system inference for stochastic systems. In some generality, MLE will converge to the correct model in the infinite data limit. In the context of physical approaches to system inference, such as Boltzmann machines, MLE requires the arduous computation of pa…
New method calculates degrees of freedom for sparse estimation in continuous models.
problem Quantifying effective parameters in over-parameterized models with large continuous parameter spaces.
method Develops a continuous Lasso method for sparsity-inducing optimization over measure spaces.
result Proof of a continuous degrees of freedom formula for Beurling Lasso.
We re-examine classical mechanics with both commuting and anticommuting degrees of freedom. We do this by defining the phase dynamics of a general Lagrangian system as an implicit differential equation in the spirit of Tulczyjew. Rather than parametrising our basic degrees of freedom by a specified Grassmann algebra, w…
Fewer degrees of freedom can train deep networks, showing a sharp phase transition.
problem Training deep networks with fewer degrees of freedom than parameters.
method Examined success probability of hitting training loss sub-level sets within random subspaces.
result Threshold training dimension increases as desired final loss decreases.
The paper argues for using more degrees of freedom in empirical financial analysis to improve conclusions.
problem Improving trustworthiness of financial analysis conclusions.
method Using more degrees of freedom and forking paths in multiple testing.
result Forking paths raises the bar for significance in multiple testing.
EPGP surrogate outperforms finite elements in solving wave equations.
problem Benchmarking Gaussian Process surrogates vs. finite elements for wave equation solutions.
method EPGP uses penalized least squares and exponential-polynomial bases; CN-FEM employs Crank--Nicolson time stepping.
result EPGP achieves lower error than CN-FEM under matched degrees-of-freedom.
We discuss normal forms and symplectic invariants of parabolic orbits and cuspidal tori in integrable Hamiltonian systems with two degrees of freedom. Such singularities appear in many integrable systems in geometry and mathematical physics and can be considered as the simplest example of degenerate singularities. We a…
Physical systems differring in their microscopic details often display strikingly similar behaviour when probed at macroscopic scales. Those universal properties, largely determining their physical characteristics, are revealed by the powerful renormalization group (RG) procedure, which systematically retains "slow" de…
Directly simulates squared Bessel processes efficiently.
problem Simulating squared Bessel processes accurately and efficiently.
method Two-dimensional Chebyshev expansion for non-central chi-square distribution inverse.
result Accurate and efficient simulation for various degrees of freedom.
Deep neural networks reduce loan portfolio risk.
problem Minimizing risk in peer-to-peer lending portfolios.
method Proposed DeNN and DSNN models to predict default probability and time.
result DeNN model significantly reduces portfolio VaRs at various confidence levels.
A new method joins two arcs with a degree of freedom.
problem Joining two arcs with a precise point.
method Geometric approach using tangent vectors and points.
result A novel method to determine the join point.
Developed a new thresholding method that connects soft and hard thresholding.
problem Connecting soft and hard thresholding methods in data analysis.
method Scaled soft thresholding method with empirical scaling values.
result Found two sources of over-fitting in the scaled soft thresholding method.
Develops unisolvent weights for Nédélec second family finite elements in 2D.
problem Finding efficient degrees of freedom for Nédélec second family finite elements.
method Uses techniques of homological algebra to obtain degrees of freedom for differential forms.
result Provides a family of unisolvent and minimal physical degrees of freedom for Nédélec second family finite elements.
We simplify supergravity in 10D using geometric insights.
problem Formulating supergravity in 10D without Lorentz degrees of freedom.
method Using generalised geometry, we describe the fibred structure of field space.
result Our action satisfies the classical master equation without Lorentz terms.
For an integrable Hamiltonian with d (d≥2) degrees of freedom, we show the conditions on perturbations, for which invariant tori can be destructed.
This paper studies schemes to de-bias the Lasso in a linear model y=Xβ+ε where the goal is to construct confidence intervals for a0Tβ in a direction a0, where X has iid N(0,Σ) rows. We show that previously analyzed propositions to de-bias the Lasso require a modification in order to enjoy efficiency in a f…
Transformers reduce redundancy by focusing on invariant relational quantities.
problem Substantial internal redundancy in Transformer models due to coordinate-dependent representations and continuous symmetries.
method Reformulate representations, attention mechanisms, and optimization dynamics in terms of invariant relational quantities, eliminating redundant degrees of freedom by construction.
result Architectures that operate directly on relational structures, providing a principled geometric framework for reducing parameter redundancy and analyzing optimization.
AI agents improve forecast combination in empirical economics.
problem Hidden researcher degrees of freedom in AI-generated code.
method Adapted agent-loop architecture to empirical economics, added holdout evaluation.
result Independent agent searches find better forecast methods than benchmarks.
Paper develops methods for estimating and simulating a Student-t Lévy regression model.
problem Estimation and simulation of Student-t Lévy process with arbitrary degrees of freedom.
method Develops a two-step estimation procedure and simulates increments using inverse Fourier transform.
result Efficient estimation and simulation methods for Student-t Lévy process.
DriftLite improves inference quality of diffusion models without retraining.
problem Adapting pre-trained diffusion models to new target distributions without retraining.
method Lightweight, training-free particle-based approach that steers inference dynamics with optimal stability control.
result Consistently reduces variance and improves sample quality over existing methods.
A method to automatically choose feature dimensions in linear attention for better approximation quality.
problem Choosing the feature dimension in linear attention to balance quality and efficiency.
method Statistical degrees of freedom for determining feature dimension, layer-wise training strategy.
result Our method achieves smaller approximation error compared to fixed dimensions and improves model performance.
AI agents improve forecast combination but require transparency.
problem AI coding agents increase flexibility in empirical economics, leading to hidden degrees of freedom.
method Adapted open-source agent-loop architecture to empirical economics workflow, adding post-search holdout evaluation.
result Multiple agent runs outperform standard benchmarks in rolling evaluation but not all on post-search holdout.
Choosing appropriate architectures and regularization strategies for deep networks is crucial to good predictive performance. To shed light on this problem, we analyze the analogous problem of constructing useful priors on compositions of functions. Specifically, we study the deep Gaussian process, a type of infinitely…
The runtime for Kernel Partial Least Squares (KPLS) to compute the fit is quadratic in the number of examples. However, the necessity of obtaining sensitivity measures as degrees of freedom for model selection or confidence intervals for more detailed analysis requires cubic runtime, and thus constitutes a computationa…
In this note, we consider generalizations of the asymptotic Hopf invariant, or helicity, for Hamiltonian systems with one-and-a-half degrees of freedom and symplectic diffeomorphisms of a two-disk to itself.
New complexity measures explain overparameterized models' surprising performance.
problem Understanding why overparameterized models generalize well despite fitting training data.
method Reinterpreting classical degrees of freedom in a random-X setting.
result Random-X prediction error better explains generalization in complex models.
SIMPLE method quantifies uncertainty in network membership profiles.
problem Quantifying statistical uncertainty in network membership profiles.
method Degree-corrected mixed membership model, Hotelling-type statistics.
result Established exact limiting distributions of test statistics.
Simple model finds high correlation in retail crypto returns.
problem Discerning correlation in retail cryptocurrency markets without factors.
method Used N*(N) statistic to compare models of daily returns.
result High average pairwise correlation (60%) found, supports isotropic model.
Novel digital twin for complex systems improves performance.
problem Lack of practical implementation details for stochastic nonlinear MDOF systems.
method Decouples time-scales, uses physics-based model, Bayesian filtering, and machine learning.
result Excellent performance of proposed digital twin framework validated by examples.
The paper proposes a thermodynamic potential to guide training of generative models, breaking ergodicity to improve functionality.
problem Improving generative model functionality while limiting access to underrepresented patterns.
method Constructing a thermodynamic potential that guides training, leading to multiple minima in the free energy.
result Training a generative model breaks ergodicity, preventing escape into the high-temperature phase.
A new ML method predicts long-time-step molecular dynamics, preserving symplectic and time-reversible properties.
problem Limited computational efficiency in long-time-step molecular dynamics simulations.
method Learning data-driven structure-preserving maps to generate long time-step classical dynamics.
result The method eliminates artifacts like lack of energy conservation and loss of equipartition.
In sparse regression modeling via regularization such as the lasso, it is important to select appropriate values of tuning parameters including regularization parameters. The choice of tuning parameters can be viewed as a model selection and evaluation problem. Mallows' Cp type criteria may be used as a tuning param…
A new SSL method uses instance-dependent thresholds to improve accuracy.
problem Improving semi-supervised learning by better selecting confident unlabeled instances.
method Proposes instance-dependent thresholds that vary based on the ambiguity and error rates of pseudo-labels for each unlabeled instance.
result Demonstrates that instance-dependent thresholds provide a probabilistic guarantee for correct pseudo-labels.