The paper extends entropy maximization to multiscale settings and applies it to neural networks.
problem Achieving optimal risk bounds in neural networks using multiscale entropy.
method Generalizing maximum entropy to multiscale settings and applying it to neural networks.
result The multiscale Gibbs posterior can achieve a smaller excess risk than the single-scale Gibbs posterior in a teacher-student scenario.
Proposes a new algorithm for non-stationary bandits.
problem Non-stationary reward distributions in contextual bandits.
method Multiscale changepoint detection for adaptive learning.
result Regret bound analysis and superior performance in experiments.
Deterministic GD can behave stochastically in large learning rates for multiscale functions.
problem Understanding deterministic GD's stochastic behavior in large learning rates for multiscale objectives.
method Established a sufficient condition for deterministic GD to converge to a rescaled Gibbs distribution in large learning rates for multiscale functions.
result Deterministic GD can converge to a statistical distribution in large learning rates for multiscale functions.
Delayed rejection HMC improves sampling efficiency for multiscale distributions.
problem Hamiltonian Monte Carlo struggles with wide-ranging distributions, especially in high-curvature areas.
method Introduces a delayed rejection variant of HMC, using geometrically smaller step sizes for retries.
result Up to five-fold performance gains in effective sample size per gradient evaluation.
A new sampling method estimates scores without training or nested MCMC.
problem Efficient sampling from complex, unnormalised distributions.
method Multiscale averaging in SDEs for score estimation.
result Empirical results show competitive accuracy and efficiency.
A framework learns multiscale dynamics from single trajectories using normalizing flows.
problem Learning effective stochastic dynamics from single observed paths of slow variables.
method Data-driven approach based on coupled multiscale SDEs, stochastic averaging, and normalizing flows for density modeling.
result Scalable approach to capturing epistemic uncertainty in multiscale systems.
The paper proposes a method to estimate latent structures in multivariate data without assuming their existence.
problem Estimating latent structures in multivariate distributions that are difficult to identify and reflect the data generating mechanism.
method A model-free approach using a multiscale nonparametric maximum likelihood estimator.
result The method captures meaningful discrete structure at different scales and integrates them to yield an interpretable discrete representation.
Method learns dynamics of slow variables from stochastic data.
problem Modeling unknown multiscale stochastic systems with limited data.
method Data-driven approach to learn effective dynamics from bursts of observation data.
result Generative model accurately captures effective dynamics of slow variables.
Generative Distribution Embeddings learn multiscale representations of distributions.
problem Learning representations of entire distributions for multiscale reasoning.
method Introducing GDE framework that lifts autoencoders to the space of distributions, using conditional generative models and distributional invariance.
result GDEs learn predictive sufficient statistics embedded in Wasserstein space, recovering distances and trajectories for Gaussian and Gaussian mixture distributions.
Generative models improve for multiscale scientific data with new noise and interpolation techniques.
problem Numerical challenges in generating high-fidelity samples for multiscale scientific data.
method Design of noise distributions and interpolation schedules in function space to ensure Lipschitz regularity and finite noise roughness.
result Scale-adaptive noise and interpolation schedules improve numerical efficiency and fidelity of generated samples.
GINNs combine deep learning with PGMs for physics-based multiscale systems.
problem Intrinsic computational bottlenecks and lack of sufficient data for QoI estimation.
method Hybrid approach combining deep learning with probabilistic graphical models, informed by structured priors for CVs.
result GINNs produce tight confidence intervals for non-Gaussian QoIs.
The paper proves Gorenstein contractions for multiscale differentials on nodal curves.
problem Proving Gorenstein contractions for multiscale differentials on nodal curves.
method Addressing the conjecture by Ranganathan and Wise, showing contractions level by level.
result Multiscale differentials can be contracted to Gorenstein singularities, level by level, from the top down.
Bayesian model learns multiscale interactions in complex systems.
problem Understanding dynamic interplay between processes at different time scales.
method Bayesian learning framework with Particle Gibbs with Ancestor Sampling (PGAS) algorithm.
result Demonstrated the effectiveness of the proposed approach through simulations.
DMGNN predicts 3D human motions using adaptive multiscale graphs.
problem Predicting 3D skeleton-based human motions accurately.
method Dynamic multiscale graph neural networks (DMGNN) with adaptive multiscale graphs and MGCU.
result DMGNN outperforms state-of-the-art methods in short and long-term predictions.
Neural network approach simplifies multiscale problem homogenization.
problem Homogenizing multiscale problems with varying microscale structures.
method Derivative-free neural network with Brownian walkers.
result Neural network method is computationally efficient and robust.
Entropy-based model for hierarchical learning from multiscale data.
problem Learning from data with auxiliary information and multiscale target functions.
method Entropy-based hierarchical learning model with multiscale entropies.
result Entropy-based model yields stronger guarantees than uniform convergence bounds.
This paper proposes a novel multiscale estimator for the integrated volatility of an Ito process, in the presence of market microstructure noise (observation error). The multiscale structure of the observed process is represented frequency-by-frequency and the concept of the multiscale ratio is introduced to quantify t…
We discuss multiscale representations of discrete manifold-valued data. As it turns out that we cannot expect general manifold-analogues of biorthogonal wavelets to possess perfect reconstruction, we focus our attention on those constructions which are based on upscaling operators which are either interpolating or midp…
Derives PDEs from data using manifold learning and neural networks.
problem Identifying PDEs from unknown variables and dynamics.
method Combines manifold learning (Diffusion Maps) and neural networks.
result Emergent space identification connects with multiscale computation.
We present a graph-theoretical approach to data clustering, which combines the creation of a graph from the data with Markov Stability, a multiscale community detection framework. We show how the multiscale capabilities of the method allow the estimation of the number of clusters, as well as alleviating the sensitivity…
MELD model clusters data at multiple scales, improving understanding of latent structure.
problem Understanding latent multiscale structure in datasets.
method Multiscale Learning by Unsupervised Nonlinear Diffusion (M-LUND) algorithm.
result M-LUND detects latent structure in synthetic and real datasets.
Market Mill is a complex dependence pattern leading to nonlinear correlations and predictability in intraday dynamics of stock prices. The present paper puts together previous efforts to build a dynamical model reflecting the market mill asymmetries. We show that certain properties of the conditional dynamics at a sing…
New algorithm learns switching dynamics from multiple neural signals.
problem Learning accurate switching dynamical system models from multimodal neural data.
method Unsupervised learning algorithm for multiscale switching dynamical system models.
result Switching multiscale dynamical system models outperform single-scale models in behavior decoding.
Nonparametric estimation of the conditional distribution of a response given high-dimensional features is a challenging problem. It is important to allow not only the mean but also the variance and shape of the response density to change flexibly with features, which are massive-dimensional. We propose a multiscale dic…
Optimal multiscale learning of linear operators
problem Statistical and computational limits of learning bounded linear operators between Sobolev spaces
method Reformulate as an infinite-dimensional matrix regression problem with heterogeneous multiscale structure
result Establish minimax rates and construct a finite-resolution blockwise least-squares estimator attaining these rates
MsIGN tackles high-dimensional Bayesian inference using multiscale structure.
problem High-dimensional Bayesian inference challenges due to the curse of dimensionality.
method MsIGN generates samples from coarse to fine scale, minimizing Jeffreys divergence.
result MsIGN outperforms previous approaches in posterior approximation and mode capture.
Kernel analog forecasting studied for multiscale systems.
problem Interpreting data-driven predictions in multiscale dynamical systems.
method Kernel analog forecasting methods applied to multiscale systems with varying Markovian closures.
result Guidance provided for interpreting data-driven predictions in practice.
New method analyzes knots and links using multiscale Gauss link integral.
problem Lack of localization and quantization in knot theory applications.
method Integrates curve segmentation and multiscale analysis into the Gauss link integral.
result Significantly outperforms other methods in protein flexibility analysis.
The paper provides an efficient method to price path-dependent derivatives using multiscale stochastic volatility models.
problem Pricing path-dependent derivatives under multiscale stochastic volatility models.
method Derives a Malliavin representation for the first-order approximation of the price of path-dependent derivatives.
result An efficient Monte Carlo approximation for pricing path-dependent derivatives is derived.
Novel graph network learns hierarchical network structure.
problem Lack of information in hierarchical network topology.
method Hierarchical clustering for multiscale decomposition, graph convolutional layers.
result Competitive performance on citation network benchmark.
Extracts causal brain dynamics across multiple scales.
problem Statistical associations do not reflect causal mechanisms in brain dynamics.
method Multiscale causal backbone (MCB) extraction using advanced causal structure learning.
result Sparse MCBs reveal distinct causal roles at different brain frequency bands.
In this paper we show similarities between turbulence and financial systems. Motivated by similarities between the two systems, we construct a multiscale model for hierarchical financial structures that exhibits a constant cascade of wealth from large financial entities to small financial entities. According to our mod…
New algorithm clusters hyperspectral images at multiple scales.
problem Clustering hyperspectral images at various scales.
method M-SRDL algorithm using spectral-spatial diffusion distances.
result More accurate clustering labels achieved with spatial regularization.
MCE reduces embedding instability in nonlinear dimensionality reduction.
problem Embedding instability caused by random initialization.
method Median of multiple embeddings (MCE) based on large deviation theory.
result MCE achieves consistency at an exponential rate and effectively mitigates instability.
iLED framework offers interpretable dynamics for multiscale systems.
problem Modeling high-dimensional multiscale systems is challenging.
method Interpretable Learning Effective Dynamics (iLED) framework based on Mori-Zwanzig and Koopman operator theory.
result Comparable accuracy to state-of-the-art approaches with added interpretability.
Study compares Bitcoin, gold, and gas price complexity using multifractal and multiscale entropy methods.
problem Quantifying complexity of financial time series for market analysis.
method Employed MF-DFA and RCMSE to analyze Bitcoin, GBP/USD, gold, and natural gas price log-return time series.
result Bitcoin shows higher complexity compared to other markets, linked to higher nonlinear correlations.
Standard Gaussian Process (GP) regression, a powerful machine learning tool, is computationally expensive when it is applied to large datasets, and potentially inaccurate when data points are sparsely distributed in a high-dimensional feature space. To address these challenges, a new multiscale, sparsified GP algorithm…
This paper investigates the hedging effectiveness of a dynamic moving window OLS hedging model, formed using wavelet decomposed time-series. The wavelet transform is applied to calculate the appropriate dynamic minimum-variance hedge ratio for various hedging horizons for a number of assets. The effectiveness of the dy…
We perform a scaling analysis on NYSE daily returns. We show that volatility correlations are power-laws on a time range from one day to one year and, more important, that they exhibit a multiscale behaviour.
In this paper, we propose a generic framework for devising an adaptive approximation scheme for value function approximation in reinforcement learning, which introduces multiscale approximation. The two basic ingredients are multiresolution analysis as well as tree approximation. Starting from simple refinable function…
Study optimal futures trading strategies for assets with multiscale central tendency price model.
problem Optimal dynamic trading of futures with multiscale central tendency price model.
method Derive no-arbitrage futures prices, solve HJB equations for optimal strategies.
result Optimal trading strategies depend on asset parameters and futures risk premia.
Many problems in sequential decision making and stochastic control often have natural multiscale structure: sub-tasks are assembled together to accomplish complex goals. Systematically inferring and leveraging hierarchical structure, particularly beyond a single level of abstraction, has remained a longstanding challen…
New MHSNs extract multiscale features from complex data for robust classification.
problem Signal classification and domain classification on complex data.
method Layered structure with multiscale basis dictionaries, pooling operations, and invariant features.
result High-accuracy classification with fewer parameters than traditional graph neural networks.
Recent advancements in recurrent neural network (RNN) research have demonstrated the superiority of utilizing multiscale structures in learning temporal representations of time series. Currently, most of multiscale RNNs use fixed scales, which do not comply with the nature of dynamical temporal patterns among sequences…
This work sets lower bounds on the number of score queries needed for diffusion sampling.
problem Establishing information-theoretic limits on the number of score evaluations required for diffusion sampling.
method Proving lower bounds on the number of adaptive score queries needed for sampling.
result Any sampling algorithm requires at least \(\widetilde{\Omega}(\sqrt{d})\) adaptive score queries for \(d\)-dimensional distributions.
Current state-of-the-art discrete optimization methods struggle behind when it comes to challenging contrast-enhancing discrete energies (i.e., favoring different labels for neighboring variables). This work suggests a multiscale approach for these challenging problems. Deriving an algebraic representation allows us to…
Framework models multiscale dynamics with Bayesian learning for regime changes.
problem Analyzing complex interactions between fast and slow processes.
method Hierarchical state-space modeling with Sequential Monte Carlo.
result Bayesian approach accurately tracks state transitions and identifies switching dynamics.
We study the multiscale simplicial flat norm (MSFN) problem, which computes flat norm at various scales of sets defined as oriented subcomplexes of finite simplicial complexes in arbitrary dimensions. We show that the multiscale simplicial flat norm is NP-complete when homology is defined over integers. We cast the mul…