New linear flows using exponential of linear transformations improve generative models.
problem Improving generative models in machine learning.
method Developed convolution exponentials and generalized Sylvester Flows using the exponential of linear transformations.
result Convolution exponentials and Convolutional Sylvester Flows outperform other models in log-likelihood.
New oracle Search improves active learning performance exponentially.
problem Enhancing active learning with limited oracle access.
method Combines Label and Search oracles for better decision-making.
result Exponential improvement in problem-solving performance.
Improved risk-sensitive RL with exponential Bellman equation and better regret bounds.
problem Exponential gap between upper and lower bounds in risk-sensitive RL.
method Identified and addressed deficiencies in existing algorithms and analysis; developed novel analysis and exploration mechanism.
result Improved regret upper bounds over existing ones.
New hyperbolic manifolds show exponential homology torsion growth.
problem Understanding growth of torsion in homology groups of hyperbolic manifolds.
method Constructed a family of hyperbolic manifolds with specific growth properties.
result Demonstrated that recent bound on homological torsion is asymptotically sharp.
ELNN uses neural networks for improved option pricing.
problem Inconsistent pricing of over-the-counter products and unacceptable outcomes in ANN-based models.
method ELNN integrates ANNs with the exponential Levy model, addressing issues with existing models.
result ELNN outperforms Merton and Kou models in fitting performance and stability of estimates.
Study improves the exponential rate of metric difference in Higgs bundles.
problem Improving the exponential rate of metric difference in Higgs bundles.
method Analyzes the Hitchin metric and semi-flat metric in rank two Higgs bundles.
result Exponential rate of metric difference is improved.
Incorporates matrix exponential into generative flows for improved performance.
problem Improving generative flow models for better density estimation.
method Integrates matrix exponential into generative flows, proposing new layers and modifying network architecture.
result The proposed model achieves great performance on density estimation.
Quantum algorithm improves generative models exponentially.
problem Finding efficient quantum algorithms for generative machine learning.
method Proposes a quantum generative model with exponential speedup.
result Exponential speedup in training and inference for some instances.
Exponentially smoothed RNNs improve industrial forecasting.
problem Complexity and non-stationarity in industrial time series data.
method Exponential smoothed recurrent neural networks (RNNs) for modeling non-linear dynamics.
result Exponentially smoothed RNNs outperform traditional models in multi-step forecasting.
Improved GNN simulation of WL test with exponentially lower complexity.
problem Improving the complexity of simulating the Weisfeiler-Lehman test with GNNs.
method Exponentially lower complexity simulation of WL test using GNNs with polylogarithmic parameters and O(log n) bits feature vectors.
result Near-optimal construction with logarithmic lower bounds for feature vector length and neural network size.
Improved Gibbs sampler speeds up Bayesian exponential smoothing model.
problem Computational inefficiency of original NUTS sampler.
method Modifications to the original model and a bespoke Gibbs sampler.
result Significant improvement in sampling time by an order of magnitude.
Boosting with tempered exponential measures improves AdaBoost's convergence rate.
problem Improving the convergence rate of AdaBoost.
method Introducing tempered exponential measures (TEMs) to generalize AdaBoost's approach.
result t-AdaBoost achieves an improved convergence rate compared to AdaBoost, especially for t ∈ [ 0 , 1 ) t \in [0,1) t ∈ [ 0 , 1 ) . ETM models improve efficiency in semi-supervised logistic regression.
problem Improving efficiency in logistic regression with limited labeled data.
method Developed exponential tilt mixture (ETM) models for semi-supervised estimation.
result ETM-based estimation demonstrates improved efficiency over supervised logistic regression.
New insights into natural exponential families improve regret bounds for bandit problems.
problem Improving regret bounds for bandit problems with subexponential tails.
method Proving self-concordance for natural exponential families and applying to bandits.
result Optimistic algorithms for generalized linear bandits have second-order regret bounds that are free of an exponential dependence on problem parameters.
AdamNX improves Adam's stability by adjusting its learning rate.
problem Adam's tendency to converge to non-flat minima in large-scale models.
method Proposes a novel exponential decay mechanism for Adam's second-order moment estimate.
result AdamNX outperforms Adam and its variants in stability and performance.
Auto-regressive models improve smoothing efficiency with exponentially tapered windows.
problem Improving time-series smoothing efficiency.
method An auto-regressive formulation for time-series smoothing.
result Auto-regressive models result in moving means with exponentially tapered windows.
New ensemble method improves model stability exponentially.
problem Improving model stability for discontinuous base learners.
method Selecting the most frequently generated model from subsamples.
result Exponentially decaying tails for excess risk.
Normalization layers control deep neural network capacity, improving stability and generalization.
problem Excessive capacity in deep neural networks leads to overfitting and poor generalization.
method Developed a theoretical framework to explain normalization's role in capacity control.
result Normalization layers reduce the Lipschitz constant exponentially, smoothing the loss landscape and enhancing generalization.
Improved option pricing model with transaction costs.
problem Inaccurate option pricing without considering transaction costs.
method Developed a replicating strategy with exponentially decreasing transaction costs.
result Validated the effectiveness of the new model through simulations.
AdaX improves Adam by exponentially accumulating past gradients, leading to better performance in machine learning tasks.
problem Adam's fast convergence can lead to local minimums in non-convex problems.
method AdaX exponentially accumulates past gradients to adaptively tune the learning rate.
result AdaX outperforms Adam in various machine learning tasks, including computer vision and natural language processing.
Efficient method for learning continuous exponential families beyond Gaussian.
problem Learning continuous exponential families with unbounded support.
method Interaction Screening approach for scalable learning of continuous graphical models.
result Our estimator maintains similar accuracy and sample complexity scalings compared to alternative approaches, while improving run-time.
Quantum UCB algorithm reduces reinforcement learning regret exponentially.
problem Episodic reinforcement learning with quantum state evolution.
method Upper Confidence Bound (UCB) quantum algorithm with quantum mean estimation.
result Exponential improvement in regret from $\Tilde{\mathcal{O}}(\sqrt{K})$ to $\Tilde{\mathcal{O}}(1)$ .
The article improves prediction by aggregating Kalman recursions online.
problem Improving expert aggregation in prediction models.
method Using exponential weights and state-space models to aggregate Kalman recursions.
result New algorithms outperform existing methods in Kalman recursion expert aggregation.
Probabilistic solvers improve stability for stiff systems.
problem Performance penalties for small steps in stiff systems.
method Probabilistic exponential integrators that include fast linear dynamics in the prior.
result Proven L-stability and probabilistic error accounting.
The study improves bounds on the number of closed geodesics and logarithmic improvements in the Weyl law.
problem Estimating the number of closed geodesics and improving logarithmic bounds in the Weyl law.
method Study of non-degeneracy properties of nearly closed orbits for predominant sets of metrics.
result Logarithmic improvements in the Weyl law and exponential bounds on the number of closed geodesics.
Improved sample complexity for identifying best policies in risk-sensitive reinforcement learning.
problem Identifying approximately optimal policies in risk-sensitive reinforcement learning with exponential horizon dependence.
method Forward-model based algorithm with KL-based exploration bonuses adapted for entropic criterion, leveraging smoothness properties of exponential utility and a new stopping rule.
result Achieved sample complexity matching the lower bound, closing the gap between upper and lower bounds.
Tensor networks improve integration accuracy for high-dimensional problems.
problem Integration of high-dimensional functions with exponential convergence.
method Regression-free tensor network representations for integration.
result Exponential convergence achieved for non-analytic integrands.
Estimates exponential family distributions using a novel doubly dual embedding technique.
problem Estimating exponential family distributions with smoothness and efficiency.
method Doubly dual embedding for avoiding partition function computation and flexible sampling.
result Improves memory and time efficiency while offering stronger statistical properties.
Space exploration technology advances exponentially, consistent with Moore's and Wright's laws.
problem Predicting the advancement of space exploration technology.
method Analysis of Moore's and Wright's laws applied to space exploration technology.
result Spacecraft technology advances exponentially, consistent with Moore's and Wright's laws.
SPLBoost improves robustness of AdaBoost by incorporating self-paced learning.
problem AdaBoost's sensitivity to random noise/outliers.
method Integrating self-paced learning into Boosting framework.
result SPLBoost achieves improved robustness compared to traditional Boosting algorithms.
A multivariate Hawkes process with sum-of-three-exponentials kernel fits limit order book data well.
problem Capturing clustering behavior in financial systems using Hawkes processes.
method Fitted multivariate Hawkes process with sum-of-three-exponentials kernel to limit order book data, tested for goodness-of-fit and stationarity.
result Sum-of-three-exponentials kernel yields the best fit to coupled point processes.
We analyze the data on personal income distribution from the Australian Bureau of Statistics. We compare fits of the data to the exponential, log-normal, and gamma distributions. The exponential function gives a good (albeit not perfect) description of 98% of the population in the lower part of the distribution. The lo…
TTERGM models improve social network predictions by incorporating triadic relationships.
problem Lack of models capturing triadic relationships and social learning theories in temporal network data.
method Introduced TTERGM, a generative model that includes triadic relationships and social learning theory as additional probability distributions. Parameters are estimated via Monte Carlo maximum likelihood.
result TTERGM achieves improved accuracy and fidelity compared to existing models on social network data.
We describe \textit{deep exponential families} (DEFs), a class of latent variable models that are inspired by the hidden structures used in deep neural networks. DEFs capture a hierarchy of dependencies between latent variables, and are easily generalized to many settings through exponential families. We perform infere…
Improved KLMC for sampling under various conditions.
problem Stable simulation of kinetic Langevin dynamics under different parameters.
method Revisited synchronous Wasserstein coupling analysis with stochastic exponential Euler discretization.
result Exponential integrator can simulate kinetic Langevin dynamics in the overdamped regime with proper time acceleration.
We improve deep threshold networks' memorization capacity exponentially.
problem Memorizing datasets with randomized labels using deep neural networks.
method Using Gaussian random weights in the first layer and binary or integer weights in subsequent layers, we prove a new dependence on minimum distance.
result We show that O ~ ( 1 δ + n ) \widetilde{\mathcal{O}}(\frac{1}{\delta} + \sqrt{n}) O ( δ 1 + n ) neurons and O ~ ( d δ + n ) \widetilde{\mathcal{O}}(\frac{d}{\delta} + n) O ( δ d + n ) weights are sufficient. Annealed Entropic Allocation improves ranking and selection by mitigating hard switching and improving finite-budget discrimination.
problem Sequential budget allocation in ranking and selection
method Annealed weighted soft-min framework
result Surrogate converges uniformly to the hard minimum, soft-min weights concentrate on active challengers, and target allocation map is continuous.
The goal of this thesis is to study the singularities of the exponential map of Riemannian and Finsler manifolds (a concept related to caustics and catastrophes), and the object known as the cut locus (aka ridge, medial axis or skeleton), to improve existing results about its structure, to look at it in new ways, and t…
Unified framework for understanding TVO and improving model learning.
problem Improving the tightness and efficiency of variational inference bounds.
method Exponential family interpretation and equal spacing in moment parameters.
result Unified framework and improved gradient estimator for TVO.
Exponential Lasso improves Lasso's robustness to outliers and heavy-tailed noise.
problem Lasso's sensitivity to outliers and heavy-tailed noise in high-dimensional statistics.
method Integrates an exponential-type loss function into the Lasso framework.
result Achieves strong statistical convergence rates robust to heavy-tailed contamination.
Paper proposes an online adaptation algorithm for improving model performance.
problem Improving model fidelity in real-time for domain shift and time variance.
method Extended Kalman Filter with Exponential Moving Average and Dynamic Multi-Epoch strategy.
result Proposed algorithm outperforms existing methods in experiments.
Exponential Machines models all feature interactions in a compact format.
problem Improving machine learning performance through modeling feature interactions.
method Tensor Train format to represent interactions, stochastic Riemannian optimization for training.
result Exponential Machines achieves state-of-the-art performance on synthetic data with high-order interactions.
Researchers improve NCE by addressing its flat loss landscape issues.
problem NCE's poor performance due to an ill-behaved loss landscape.
method Introduced eNCE with an exponential loss and normalized gradient descent.
result Proven that landscape issues arise from inappropriate noise distribution.
Adversarial dynamics embedding improves MLE of exponential family models.
problem Maximum likelihood estimation of exponential family models with neural network parametrization.
method Adversarial dynamics embedding to estimate the dual sampler and primal model simultaneously.
result Adversarial dynamics embedding leads to more effective learning and improved estimators compared to existing methods.
Improves an existing algorithm for computing algebraic set homology groups.
problem Efficiently computing the homology groups of algebraic or semi-algebraic sets.
method Adaptive grid algorithm on the unit sphere.
result Practical improvement of an existing algorithm for homology computation.
Improved algorithm reduces excess risk in selective learning.
problem Selective learning with windowed model selection.
method Hybrid Exponential Weights Algorithm and bounded-recall ERM.
result Achieves expected excess risk of O((log log |L| + log log n) / log n).
Paper proposes ClipSMT algorithm for better ATE estimation.
problem Adaptive estimation of Average Treatment Effect (ATE).
method ClipSMT algorithm for improved Neyman regret.
result Achieves exponential improvements in Neyman regret.
We extend natural-gradient methods to mixtures of exponential-family distributions, improving inference speed.
problem Complex, multimodal posterior distributions are difficult to approximate with simple exponential-family distributions.
method We use minimal conditional-EF representations and derive simple natural-gradient updates.
result Our natural-gradient method converges faster than black-box methods with reparameterization gradients.